Apr 10 16:10:13 devstack cinder-volume[72439]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 16:10:13 devstack cinder-volume[72439]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 16:10:13 devstack cinder-volume[72439]: we strongly recommend against using it for new projects. Apr 10 16:10:13 devstack cinder-volume[72439]: If you are already using Eventlet, we recommend migrating to a different Apr 10 16:10:13 devstack cinder-volume[72439]: framework. For more detail see Apr 10 16:10:13 devstack cinder-volume[72439]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 16:10:13 devstack cinder-volume[72439]: import eventlet # noqa Apr 10 16:10:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:10:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:10:15 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:10:15 devstack cinder-volume[72439]: INFO dbcounter [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Registered counter for database cinder Apr 10 16:10:15 devstack cinder-volume[72439]: DEBUG oslo_db.sqlalchemy.engines [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG dbcounter [-] [72439] Writer thread running {{(pid=72439) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.rpc [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.rpc [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_db.sqlalchemy.engines [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Determined volume DB was empty at startup. Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG cinder.volume.manager [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72439) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 16:10:16 devstack cinder-volume[72439]: WARNING stevedore.named [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 16:10:16 devstack cinder-volume[72439]: WARNING castellan.key_manager [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:10:16 devstack cinder-volume[72439]: WARNING cinder.keymgr.conf_key_mgr [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG cinder.volume.drivers.lvm [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72439) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_concurrency.processutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.271s {{(pid=72439) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_db.sqlalchemy.engines [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.rpc [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.rpc [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 16:10:16 devstack cinder-volume[72439]: WARNING stevedore.named [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 16:10:16 devstack cinder-volume[72439]: WARNING castellan.key_manager [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:10:16 devstack cinder-volume[72439]: INFO cinder.volume.manager [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_db.sqlalchemy.engines [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:10:16 devstack cinder-volume[72439]: INFO oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Starting 1 workers Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Started child 72546 {{(pid=72439) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Full set of CONF: {{(pid=72439) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] ******************************************************************************** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Configuration options gathered from: {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] ================================================================================ {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] allow_availability_zone_fallback = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] allow_compression_on_image_upload = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] allowed_direct_url_schemes = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] api_rate_limit = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] auth_strategy = keystone {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] az_cache_duration = 3600 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_availability_zone = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_host = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_stats_polling_interval = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backup_api_class = cinder.backup.api.API {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backup_name_template = backup-%s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backup_use_same_host = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backup_use_temp_snapshot = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] chap_password = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] chap_username = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_internal_tenant_project_id = cad9d5d1fc714c5b93182ff1ca99311d {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_internal_tenant_user_id = 853807623a0f4de48f3902a3799098d8 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cloned_volume_same_az = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cluster = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] compression_format = gzip {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] compute_api_class = cinder.compute.nova.API {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] config_dir = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] config_source = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] control_exchange = openstack {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] debug = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] default_availability_zone = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] default_group_type = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] default_volume_type = lvmdriver-1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] disk_geometry = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] driver_client_cert = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] driver_client_cert_key = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] driver_data_namespace = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] driver_ssl_cert_path = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] driver_ssl_cert_verify = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] driver_use_ssl = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] enable_force_upload = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] enable_new_services = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] enable_unsupported_driver = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] enforce_multipath_for_image_xfer = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] filter_function = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_api_insecure = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_api_servers = ['http://192.168.122.112/image'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_api_ssl_compression = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_ca_certificates_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_catalog_info = image:glance:publicURL {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: INFO cinder.volume.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_num_retries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance_request_timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] goodness_function = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] graceful_shutdown_timeout = 5 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] group_api_class = cinder.group.api.API {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] host = devstack {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_compress_on_upload = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_conversion_address_space_limit = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_conversion_cpu_limit = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_conversion_disable = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_upload_use_cinder_backend = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_upload_use_internal_tenant = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_volume_cache_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_volume_cache_max_count = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] image_volume_cache_max_size_gb = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] init_host_max_objects_retrieval = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] instance_format = [instance: %(uuid)s] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] iscsi_target_flags = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] iscsi_write_cache = on {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] iser_helper = tgtadm {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] iser_ip_address = 192.168.122.112 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] iser_port = 3260 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_color = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_config_append = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_dir = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_options = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_rotate_interval = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_rotate_interval_type = days {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] log_rotation_type = none {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] max_age = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] max_logfile_count = 30 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] max_logfile_size_mb = 200 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] max_over_subscription_ratio = 20.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] message_reap_interval = 86400 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] message_ttl = 2592000 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] migration_create_volume_timeout_secs = 300 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] monkey_patch = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] monkey_patch_modules = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] my_ip = 192.168.122.112 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] no_snapshot_gb_quota = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] num_iser_scan_tries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] num_shell_tries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] num_volume_device_scan_tries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] nvmeof_conn_info_version = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] nvmet_ns_id = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] nvmet_port_id = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_max_limit = 1000 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_volume_ext_list = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_volume_listen_port = 8776 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_volume_use_ssl = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] osapi_volume_workers = 2 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] per_volume_size_limit = -1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] periodic_fuzzy_delay = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] periodic_interval = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] public_endpoint = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] publish_errors = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_backup_gigabytes = 1000 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_backups = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_gigabytes = 1000 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_groups = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_snapshots = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] quota_volumes = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] rate_limit_burst = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] rate_limit_except_level = CRITICAL {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] rate_limit_interval = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] reinit_driver_count = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] replication_device = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] report_discard_supported = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] report_interval = 120 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] reservation_clean_interval = 86400 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] reservation_expire = 86400 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] reserved_image_namespaces = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] reserved_percentage = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] rpc_response_timeout = 120 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] run_external_periodic_tasks = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] scst_target_driver = iscsi {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] scst_target_iqn_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_down_time = 720 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] shell_completion = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] snapshot_name_template = snapshot-%s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] snapshot_same_host = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] split_loggers = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] state_path = /opt/stack/data/cinder {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] storage_availability_zone = nova {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] storage_protocol = iSCSI {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] syslog_log_facility = LOG_USER {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] target_helper = lioadm {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] target_ip_address = 192.168.122.112 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] target_port = 3260 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] target_protocol = iscsi {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] target_secondary_ip_addresses = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] trace_flags = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] transport_url = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] until_refresh = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_chap_auth = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_default_quota_class = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_journal = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_json = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_multipath_for_image_xfer = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_stderr = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] use_syslog = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] verify_glance_signatures = enabled {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_api_class = cinder.volume.api.API {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_backend_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_clear = zero {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_clear_ionice = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_clear_size = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_copy_bps_limit = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_dd_blocksize = 1M {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_name_template = volume-%s {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_service_inithost_offload = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volume_usage_audit_period = month {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] zoning_mode = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_concurrency.disable_process_locking = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.admin_password = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.admin_token = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.admin_user = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_port = 35357 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_protocol = https {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_section = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_type = password {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_uri = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.auth_version = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.cache = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.identity_uri = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.include_service_catalog = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.insecure = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.interface = public {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_password = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcache_username = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.region_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.service_type = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.112/identity {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.backend = dogpile.cache.null {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.backend_argument = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.backend_expiration_time = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.config_prefix = cache.oslo {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.debug_cache_backend = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.enable_retry_client = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.enable_socket_keepalive = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.enforce_fips_mode = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.expiration_time = 600 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.hashclient_retry_attempts = 2 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_dead_retry = 300 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_pool_maxsize = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_sasl_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.password = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.proxies = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.redis_db = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.redis_server = localhost:6379 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.retry_attempts = 2 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.retry_delay = 0.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.socket_keepalive_count = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.socket_keepalive_idle = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.socket_keepalive_interval = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.socket_timeout = 1.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.tls_allowed_ciphers = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.tls_cafile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.tls_certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.tls_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.tls_keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cache.username = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] coordination.backend_url = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.asyncio_connection = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.asyncio_slave_connection = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.backend = sqlalchemy {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.connection = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.connection_debug = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.connection_parameters = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.connection_recycle_time = 3600 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.connection_trace = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.db_inc_retry_interval = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.db_max_retries = 20 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.db_max_retry_interval = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.db_retry_interval = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.max_overflow = 50 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.max_pool_size = 5 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.max_retries = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.mysql_wsrep_sync_wait = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.pool_timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.retry_interval = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.slave_connection = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.sqlite_synchronous = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.synchronous_reader = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] database.use_db_reconnect = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.connection_string = messaging:// {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.es_doc_type = notification {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.es_scroll_size = 10000 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.es_scroll_time = 2m {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.filter_error_trace = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.hmac_keys = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.sentinel_service_name = mymaster {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.socket_timeout = 0.1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.trace_requests = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler.trace_sqlalchemy = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler_jaeger.process_tags = {} {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler_jaeger.service_name_prefix = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] profiler_otlp.service_name_prefix = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.enforce_new_defaults = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: WARNING oslo_config.cfg [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.enforce_scope = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.policy_default_rule = default {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.policy_file = policy.yaml {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.group = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.helper_command = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] privsep_osbrick.user = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.group = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.helper_command = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] cinder_sys_admin.user = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.auth_section = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.auth_type = password {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.cafile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.collect_timing = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.insecure = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.send_service_user_token = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.split_loggers = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] service_user.timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.auth_section = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.auth_type = password {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.collect_timing = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.insecure = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.region_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.split_loggers = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] glance.timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.backend_availability_zone = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.chap_password = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.chap_username = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.disk_geometry = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.driver_client_cert = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack sudo[72556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.driver_client_cert_key = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.driver_data_namespace = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.driver_use_ssl = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.extra_capabilities = {} {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.filter_function = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.goodness_function = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack sudo[72556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.iscsi_target_flags = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.iscsi_write_cache = on {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.iser_helper = tgtadm {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.iser_ip_address = 192.168.122.112 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.iser_port = 3260 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.lvm_share_target = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.lvm_type = auto {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.num_shell_tries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.replication_device = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.report_discard_supported = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.reserved_percentage = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.target_helper = tgtadm {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.target_ip_address = 192.168.122.112 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.target_port = 3260 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.target_protocol = iscsi {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.trace_flags = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.unique_fqdn_network = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.use_chap_auth = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_backend_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_clear = zero {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_clear_ionice = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_clear_size = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_reports.file_event_handler = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_reports.log_dir = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.backend_host = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.chap_password = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.chap_username = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.disk_geometry = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.driver_client_cert = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.extra_capabilities = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.filter_function = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.goodness_function = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.iser_helper = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.iser_ip_address = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.iser_port = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.lvm_share_target = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.lvm_type = auto {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.num_shell_tries = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.replication_device = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.report_discard_supported = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.reserved_percentage = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.scst_target_driver = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.storage_protocol = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.target_helper = lioadm {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.target_ip_address = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.target_port = 3260 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.trace_flags = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.use_chap_auth = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_clear = zero {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_clear_size = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] lvmdriver-1.volumes_dir = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.ssl = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_notifications.driver = [] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_notifications.retry = -1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] key_manager.fixed_key = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.barbican_api_version = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.barbican_endpoint = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.barbican_endpoint_type = public {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.barbican_region_name = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.cafile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.collect_timing = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.insecure = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.number_of_retries = 60 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.retry_delay = 1 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.send_service_user_token = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.split_loggers = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.verify_ssl = True {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican.verify_ssl_path = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.auth_section = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.auth_type = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.cafile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.certfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.collect_timing = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.insecure = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.keyfile = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.split_loggers = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] barbican_service_user.timeout = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.approle_role_id = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.approle_secret_id = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.kv_mountpoint = secret {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.kv_path = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.kv_version = 2 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.namespace = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.root_token_id = **** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.ssl_ca_crt_file = None {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.timeout = 60.0 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.use_ssl = False {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:10:16 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] ******************************************************************************** {{(pid=72439) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 16:10:17 devstack sudo[72556]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:17 devstack sudo[72718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:17 devstack sudo[72718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:17 devstack sudo[72718]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.522s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:10:17 devstack cinder-volume[72546]: INFO cinder.brick.local_dev.lvm [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:17 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:17 devstack sudo[72914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:10:17 devstack sudo[72914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:18 devstack sudo[72914]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:18 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:18 devstack cinder-volume[72546]: DEBUG cinder.brick.local_dev.lvm [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72546) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 16:10:18 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:18 devstack sudo[73073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:18 devstack sudo[73073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:19 devstack sudo[73073]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.746s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:19 devstack sudo[73237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:19 devstack sudo[73237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:19 devstack sudo[73237]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:19 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:19 devstack sudo[73241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 16:10:19 devstack sudo[73241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:20 devstack sudo[73241]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:20 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.480s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:20 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:20 devstack sudo[73244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:10:20 devstack sudo[73244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:20 devstack sudo[73244]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:20 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:20 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:20 devstack sudo[73252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:10:20 devstack sudo[73252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:21 devstack sudo[73252]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:21 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:21 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:21 devstack sudo[73255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:21 devstack sudo[73255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:21 devstack sudo[73255]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:21 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:21 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:21 devstack sudo[73260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:21 devstack sudo[73260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:21 devstack sudo[73260]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:21 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:21 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:22 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:22 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:22 devstack sudo[73264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:22 devstack sudo[73264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:22 devstack sudo[73264]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:22 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:22 devstack cinder-volume[72546]: INFO cinder.volume.drivers.lvm [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 16:10:22 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:22 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:22 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:22 devstack sudo[73328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:22 devstack sudo[73328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:23 devstack sudo[73328]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG cinder.volume.drivers.lvm [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Updating volume stats {{(pid=72546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:23 devstack sudo[73390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:10:23 devstack sudo[73390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:23 devstack sudo[73390]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:23 devstack sudo[73528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:23 devstack sudo[73528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:23 devstack sudo[73528]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:23 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:23 devstack sudo[73532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:23 devstack sudo[73532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:24 devstack sudo[73532]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:24 devstack sudo[73536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:24 devstack sudo[73536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:24 devstack sudo[73536]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:24 devstack cinder-volume[72546]: INFO cinder.volume.driver [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG cinder.volume.driver [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72546) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG oslo_db.sqlalchemy.engines [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG dbcounter [-] [72546] Writer thread running {{(pid=72546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG cinder.db.sqlalchemy.api [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Building query based on filter {{(pid=72546) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG cinder.image.image_utils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72546) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 16:10:24 devstack cinder-volume[72546]: INFO cinder.keymgr.migration [None req-fde2ba99-2c6c-4217-a9e5-642d80315232 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG cinder.volume.drivers.lvm [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Updating volume stats {{(pid=72546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 16:10:24 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:24 devstack sudo[73544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:10:24 devstack sudo[73544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:25 devstack sudo[73544]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:25 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:25 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:25 devstack sudo[73547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:25 devstack sudo[73547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:25 devstack sudo[73547]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:25 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.525s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:25 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:25 devstack sudo[73552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:25 devstack sudo[73552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:26 devstack sudo[73552]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:26 devstack sudo[73558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:26 devstack sudo[73558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:26 devstack cinder-volume[72439]: DEBUG dbcounter [-] [72439] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72439) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:10:26 devstack sudo[73558]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG cinder.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Notifying Schedulers of capabilities ... {{(pid=72546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:10:26 devstack cinder-volume[72546]: INFO cinder.volume.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Driver initialization completed successfully. Apr 10 16:10:26 devstack cinder-volume[72546]: INFO cinder.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Initiating service 2 cleanup Apr 10 16:10:26 devstack cinder-volume[72546]: INFO cinder.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Service 2 cleanup completed. Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG cinder.service [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Creating RPC server for service cinder-volume {{(pid=72546) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG cinder.service [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72546) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 16:10:26 devstack cinder-volume[72546]: INFO cinder.volume.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG cinder.volume.drivers.lvm [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Updating volume stats {{(pid=72546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 16:10:26 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:26 devstack sudo[73564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:10:26 devstack sudo[73564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:27 devstack sudo[73564]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:27 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:27 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:27 devstack sudo[73602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:27 devstack sudo[73602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:27 devstack sudo[73602]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:27 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:27 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:27 devstack sudo[73624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:10:27 devstack sudo[73624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:28 devstack sudo[73624]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:28 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:28 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:10:28 devstack sudo[73657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:10:28 devstack sudo[73657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:10:28 devstack sudo[73657]: pam_unix(sudo:session): session closed for user root Apr 10 16:10:28 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:10:28 devstack cinder-volume[72546]: INFO cinder.volume.manager [None req-585e1fad-1ea4-495d-bd28-01d6f8a3a607 None None] Driver post RPC initialization completed successfully. Apr 10 16:10:36 devstack cinder-volume[72546]: DEBUG dbcounter [-] [72546] Writing DB stats cinder:SELECT=2 {{(pid=72546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:10:38 devstack cinder-volume[72546]: DEBUG dbcounter [-] [72546] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:12:07 devstack cinder-volume[72546]: DEBUG oslo_service.periodic_task [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:12:07 devstack cinder-volume[72546]: DEBUG cinder.volume.drivers.lvm [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Updating volume stats {{(pid=72546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 16:12:07 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:12:07 devstack sudo[78634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:12:07 devstack sudo[78634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:12:08 devstack sudo[78634]: pam_unix(sudo:session): session closed for user root Apr 10 16:12:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:12:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:12:08 devstack sudo[78670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:12:08 devstack sudo[78670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:12:08 devstack sudo[78670]: pam_unix(sudo:session): session closed for user root Apr 10 16:12:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:12:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:12:08 devstack sudo[78675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:12:08 devstack sudo[78675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:12:09 devstack sudo[78675]: pam_unix(sudo:session): session closed for user root Apr 10 16:12:09 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:12:09 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:12:09 devstack sudo[78681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:12:09 devstack sudo[78681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:12:09 devstack sudo[78681]: pam_unix(sudo:session): session closed for user root Apr 10 16:12:09 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:12:09 devstack cinder-volume[72546]: DEBUG cinder.manager [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Notifying Schedulers of capabilities ... {{(pid=72546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:12:38 devstack cinder-volume[72546]: DEBUG dbcounter [-] [72546] Writing DB stats cinder:SELECT=1 {{(pid=72546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:12:38 devstack cinder-volume[72546]: DEBUG dbcounter [-] [72546] Writing DB stats cinder:UPDATE=1 {{(pid=72546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:13:07 devstack cinder-volume[72546]: DEBUG oslo_service.periodic_task [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:13:07 devstack cinder-volume[72546]: DEBUG cinder.volume.drivers.lvm [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Updating volume stats {{(pid=72546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 16:13:07 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:07 devstack sudo[80726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 16:13:07 devstack sudo[80726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:08 devstack sudo[80726]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:08 devstack sudo[80730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:13:08 devstack sudo[80730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:08 devstack sudo[80730]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:08 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:08 devstack sudo[80767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 16:13:08 devstack sudo[80767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:09 devstack sudo[80767]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:09 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:09 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:09 devstack sudo[80781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 16:13:09 devstack sudo[80781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:09 devstack sudo[80781]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:09 devstack cinder-volume[72546]: DEBUG oslo_concurrency.processutils [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:09 devstack cinder-volume[72546]: DEBUG cinder.manager [None req-cf850df1-1977-4f5a-b612-e45f7e5080c6 None None] Notifying Schedulers of capabilities ... {{(pid=72546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:13:42 devstack cinder-volume[72439]: INFO oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Caught SIGTERM, stopping children Apr 10 16:13:42 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Acquiring lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:13:42 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Acquired lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:13:42 devstack cinder-volume[72439]: DEBUG oslo_concurrency.lockutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Releasing lock "singleton_lock" {{(pid=72439) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:13:42 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Stop services. {{(pid=72439) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 16:13:42 devstack cinder-volume[72439]: DEBUG oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Killing children. {{(pid=72439) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 16:13:42 devstack cinder-volume[72439]: INFO oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Waiting on 1 children to exit Apr 10 16:13:46 devstack cinder-volume[72546]: DEBUG oslo_concurrency.lockutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Acquiring lock "singleton_lock" {{(pid=72546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:13:46 devstack cinder-volume[72546]: DEBUG oslo_concurrency.lockutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Acquired lock "singleton_lock" {{(pid=72546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:13:46 devstack cinder-volume[72546]: DEBUG oslo_concurrency.lockutils [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Releasing lock "singleton_lock" {{(pid=72546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:13:46 devstack cinder-volume[72546]: WARNING amqp [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 16:13:46 devstack cinder-volume[72546]: WARNING amqp [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 16:13:46 devstack cinder-volume[72439]: INFO oslo_service.backend._eventlet.service [None req-7725d237-8a21-49e1-a1e2-8ee31e9e59a0 None None] Child 72546 exited with status 0 Apr 10 16:13:47 devstack cinder-volume[81587]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 16:13:47 devstack cinder-volume[81587]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 16:13:47 devstack cinder-volume[81587]: we strongly recommend against using it for new projects. Apr 10 16:13:47 devstack cinder-volume[81587]: If you are already using Eventlet, we recommend migrating to a different Apr 10 16:13:47 devstack cinder-volume[81587]: framework. For more detail see Apr 10 16:13:47 devstack cinder-volume[81587]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 16:13:47 devstack cinder-volume[81587]: import eventlet # noqa Apr 10 16:13:49 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:13:49 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:13:49 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:13:49 devstack cinder-volume[81587]: INFO dbcounter [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Registered counter for database cinder Apr 10 16:13:49 devstack cinder-volume[81587]: DEBUG oslo_db.sqlalchemy.engines [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG dbcounter [-] [81587] Writer thread running {{(pid=81587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 16:13:50 devstack cinder-volume[81587]: INFO cinder.rpc [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 16:13:50 devstack cinder-volume[81587]: INFO cinder.rpc [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_db.sqlalchemy.engines [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:13:50 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Determined volume DB was empty at startup. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG cinder.volume.manager [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81587) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 16:13:50 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 16:13:50 devstack cinder-volume[81587]: WARNING stevedore.named [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 16:13:50 devstack cinder-volume[81587]: WARNING castellan.key_manager [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:13:50 devstack cinder-volume[81587]: WARNING cinder.keymgr.conf_key_mgr [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:13:50 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_db.sqlalchemy.engines [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:13:50 devstack cinder-volume[81587]: INFO oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Starting 1 workers Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Started child 81753 {{(pid=81587) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Full set of CONF: {{(pid=81587) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] ******************************************************************************** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Configuration options gathered from: {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] ================================================================================ {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] allow_availability_zone_fallback = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] allow_compression_on_image_upload = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81753]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] allowed_direct_url_schemes = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] api_rate_limit = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] auth_strategy = keystone {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_availability_zone = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_host = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_stats_polling_interval = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backup_api_class = cinder.backup.api.API {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backup_name_template = backup-%s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backup_use_same_host = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backup_use_temp_snapshot = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] chap_password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] chap_username = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_internal_tenant_project_id = cad9d5d1fc714c5b93182ff1ca99311d {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_internal_tenant_user_id = 853807623a0f4de48f3902a3799098d8 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cluster = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] compression_format = gzip {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] compute_api_class = cinder.compute.nova.API {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] config_dir = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] config_source = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] control_exchange = openstack {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] debug = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] default_availability_zone = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] default_group_type = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] default_volume_type = QuobyteHD {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] disk_geometry = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] driver_client_cert = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] driver_client_cert_key = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] driver_data_namespace = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] driver_ssl_cert_path = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] driver_ssl_cert_verify = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] driver_use_ssl = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] enable_new_services = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] enable_unsupported_driver = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] enabled_backends = ['QuobyteHD'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] enforce_multipath_for_image_xfer = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] filter_function = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_api_insecure = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_api_servers = ['http://192.168.122.112/image'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_api_ssl_compression = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_ca_certificates_file = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_catalog_info = image:glance:publicURL {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_num_retries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance_request_timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] goodness_function = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] graceful_shutdown_timeout = 5 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] group_api_class = cinder.group.api.API {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] host = devstack {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_compress_on_upload = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_conversion_address_space_limit = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_conversion_cpu_limit = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_conversion_disable = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_upload_use_cinder_backend = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_upload_use_internal_tenant = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_volume_cache_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_volume_cache_max_count = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] image_volume_cache_max_size_gb = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] init_host_max_objects_retrieval = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] instance_format = [instance: %(uuid)s] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] iscsi_target_flags = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] iscsi_write_cache = on {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] iser_helper = tgtadm {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] iser_ip_address = 192.168.122.112 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] iser_port = 3260 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_color = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_config_append = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_dir = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_file = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_options = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_rotate_interval = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_rotate_interval_type = days {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] log_rotation_type = none {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] max_age = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] max_logfile_count = 30 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] max_logfile_size_mb = 200 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] max_over_subscription_ratio = 20.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] message_reap_interval = 86400 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] message_ttl = 2592000 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] migration_create_volume_timeout_secs = 300 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] monkey_patch = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] monkey_patch_modules = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] my_ip = 192.168.122.112 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] no_snapshot_gb_quota = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] num_iser_scan_tries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] num_shell_tries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] num_volume_device_scan_tries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] nvmeof_conn_info_version = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] nvmet_ns_id = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] nvmet_port_id = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_max_limit = 1000 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_volume_ext_list = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81753]: INFO cinder.volume.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.remotefs [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81753) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_volume_listen_port = 8776 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_volume_use_ssl = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] osapi_volume_workers = 2 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] per_volume_size_limit = -1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] periodic_fuzzy_delay = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] periodic_interval = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] public_endpoint = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] publish_errors = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_backup_gigabytes = 1000 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_backups = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_gigabytes = 1000 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_groups = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_snapshots = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] quota_volumes = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] rate_limit_burst = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] rate_limit_except_level = CRITICAL {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] rate_limit_interval = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] reinit_driver_count = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] replication_device = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] report_discard_supported = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] report_interval = 120 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] reservation_clean_interval = 86400 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] reservation_expire = 86400 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] reserved_image_namespaces = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] reserved_percentage = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] rpc_response_timeout = 120 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] run_external_periodic_tasks = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] scst_target_driver = iscsi {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] scst_target_iqn_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_down_time = 720 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] shell_completion = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] snapshot_name_template = snapshot-%s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] split_loggers = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] state_path = /opt/stack/data/cinder {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] storage_availability_zone = nova {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] storage_protocol = iSCSI {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] syslog_log_facility = LOG_USER {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] target_helper = lioadm {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] target_ip_address = 192.168.122.112 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] target_port = 3260 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] target_protocol = iscsi {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] target_secondary_ip_addresses = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] trace_flags = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] transport_url = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] until_refresh = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_chap_auth = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_default_quota_class = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_journal = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_json = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_multipath_for_image_xfer = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_stderr = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] use_syslog = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] verify_glance_signatures = enabled {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_api_class = cinder.volume.api.API {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_backend_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_clear = zero {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_clear_ionice = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_clear_size = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_copy_bps_limit = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_dd_blocksize = 1M {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_name_template = volume-%s {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_service_inithost_offload = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volume_usage_audit_period = month {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] zoning_mode = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_concurrency.disable_process_locking = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.admin_password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.admin_token = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.admin_user = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_port = 35357 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_protocol = https {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_section = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_type = password {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_uri = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.auth_version = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.cache = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.identity_uri = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.include_service_catalog = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.insecure = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.interface = public {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_password = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcache_username = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.region_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.service_type = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.112/identity {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.backend = dogpile.cache.null {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.backend_argument = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.backend_expiration_time = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.config_prefix = cache.oslo {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.debug_cache_backend = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.enable_retry_client = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.enable_socket_keepalive = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.enforce_fips_mode = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.expiration_time = 600 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.hashclient_retry_attempts = 2 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_dead_retry = 300 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_pool_maxsize = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_sasl_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.proxies = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.redis_db = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.redis_server = localhost:6379 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.retry_attempts = 2 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.retry_delay = 0.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.socket_keepalive_count = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.socket_keepalive_idle = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.socket_keepalive_interval = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.socket_timeout = 1.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.tls_allowed_ciphers = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.tls_cafile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.tls_certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.tls_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.tls_keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cache.username = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] coordination.backend_url = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.asyncio_connection = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.asyncio_slave_connection = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.backend = sqlalchemy {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.connection = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.connection_debug = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.connection_parameters = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.connection_recycle_time = 3600 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.connection_trace = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.db_inc_retry_interval = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.db_max_retries = 20 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.db_max_retry_interval = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.db_retry_interval = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.max_overflow = 50 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.max_pool_size = 5 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.max_retries = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.mysql_wsrep_sync_wait = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.pool_timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.retry_interval = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.slave_connection = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.sqlite_synchronous = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.synchronous_reader = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] database.use_db_reconnect = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81753) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81753]: WARNING cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.connection_string = messaging:// {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.es_doc_type = notification {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81753]: WARNING cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.es_scroll_size = 10000 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.es_scroll_time = 2m {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.filter_error_trace = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.hmac_keys = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.sentinel_service_name = mymaster {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Running cmd (subprocess): mount.quobyte {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.socket_timeout = 0.1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.trace_requests = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler.trace_sqlalchemy = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler_jaeger.process_tags = {} {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler_jaeger.service_name_prefix = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] profiler_otlp.service_name_prefix = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.enforce_new_defaults = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: WARNING oslo_config.cfg [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.enforce_scope = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.policy_default_rule = default {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.policy_file = policy.yaml {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.group = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.helper_command = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] privsep_osbrick.user = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.group = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.helper_command = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] cinder_sys_admin.user = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.auth_section = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.auth_type = password {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.cafile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.collect_timing = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.insecure = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.send_service_user_token = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.split_loggers = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] service_user.timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.auth_section = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.auth_type = password {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.collect_timing = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.insecure = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.region_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.split_loggers = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] glance.timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.backend_availability_zone = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.chap_password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.chap_username = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.disk_geometry = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.driver_client_cert = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.driver_client_cert_key = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.driver_data_namespace = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.driver_use_ssl = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.extra_capabilities = {} {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.filter_function = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.goodness_function = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.iscsi_target_flags = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.iscsi_write_cache = on {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.iser_helper = tgtadm {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.iser_ip_address = 192.168.122.112 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.iser_port = 3260 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_host = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_login = admin {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_mount_options = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_private_key = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_share_path = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.num_shell_tries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.quobyte_volume_url = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.replication_device = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.report_discard_supported = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.reserved_percentage = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.target_helper = tgtadm {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.target_ip_address = 192.168.122.112 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.target_port = 3260 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.target_protocol = iscsi {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.trace_flags = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.unique_fqdn_network = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.use_chap_auth = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_backend_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_clear = zero {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_clear_ionice = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_clear_size = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_reports.file_event_handler = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_reports.log_dir = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.backend_availability_zone = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.backend_host = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.chap_password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.chap_username = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.chiscsi_conf = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.disk_geometry = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.driver_client_cert = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.driver_data_namespace = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.driver_use_ssl = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.extra_capabilities = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.filter_function = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.goodness_function = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.iser_helper = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.iser_ip_address = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.iser_port = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.iser_target_prefix = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_host = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_login = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_mount_options = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_password = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_private_key = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_share_path = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_ssh_port = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.num_shell_tries = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.nvmet_port_id = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.replication_device = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.report_discard_supported = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.reserved_percentage = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.scst_target_driver = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.storage_protocol = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.target_helper = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.target_ip_address = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.target_port = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.target_prefix = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.target_protocol = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.trace_flags = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.use_chap_auth = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_clear = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_clear_size = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] QuobyteHD.volumes_dir = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack quobyte-client[81754]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack quobyte-client[81754]: Invalid parameters found, error: missing mount point. Apr 10 16:13:50 devstack quobyte-client[81754]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack quobyte-client[81754]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.ssl = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_notifications.driver = [] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_notifications.retry = -1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] key_manager.fixed_key = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.barbican_api_version = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.barbican_endpoint = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.barbican_endpoint_type = public {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.barbican_region_name = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.cafile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.collect_timing = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.insecure = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.number_of_retries = 60 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.retry_delay = 1 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.send_service_user_token = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.split_loggers = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.verify_ssl = True {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican.verify_ssl_path = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.auth_section = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.auth_type = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.cafile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.certfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.collect_timing = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.insecure = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.keyfile = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.split_loggers = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] barbican_service_user.timeout = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.approle_role_id = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.approle_secret_id = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.kv_mountpoint = secret {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.kv_path = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.kv_version = 2 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.namespace = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.root_token_id = **** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.ssl_ca_crt_file = None {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.timeout = 60.0 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.use_ssl = False {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:13:50 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] ******************************************************************************** {{(pid=81587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=81753) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:13:50 devstack cinder-volume[81753]: INFO cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 ... Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b -c /etc/quobyte/client-cinder.cfg {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:50 devstack sudo[81755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b -c /etc/quobyte/client-cinder.cfg Apr 10 16:13:50 devstack sudo[81755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:50 devstack sudo[81755]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.550s {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:50 devstack cinder-volume[81753]: INFO cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 succeeded Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=81753) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.558s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:13:50 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:50 devstack sudo[81824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:13:50 devstack sudo[81824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:51 devstack sudo[81824]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.432s {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:51 devstack cinder-volume[81753]: INFO cinder.volume.driver [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Driver hasn't implemented _init_vendor_properties() Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.volume.driver [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81753) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_db.sqlalchemy.engines [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG dbcounter [-] [81753] Writer thread running {{(pid=81753) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.db.sqlalchemy.api [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Building query based on filter {{(pid=81753) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.image.image_utils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81753) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 16:13:51 devstack cinder-volume[81753]: INFO cinder.keymgr.migration [None req-99ffa910-c22f-4a04-9505-b38f28fd4d9a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=81753) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=81753) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:51 devstack sudo[81827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:13:51 devstack sudo[81827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:51 devstack sudo[81827]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.442s {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Notifying Schedulers of capabilities ... {{(pid=81753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:13:51 devstack cinder-volume[81753]: INFO cinder.volume.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Driver initialization completed successfully. Apr 10 16:13:51 devstack cinder-volume[81753]: INFO cinder.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Initiating service 3 cleanup Apr 10 16:13:51 devstack cinder-volume[81753]: INFO cinder.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Service 3 cleanup completed. Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.service [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Creating RPC server for service cinder-volume {{(pid=81753) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 16:13:51 devstack cinder-volume[81753]: DEBUG cinder.service [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81753) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 16:13:51 devstack cinder-volume[81753]: INFO cinder.volume.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=81753) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=81753) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:52 devstack sudo[81833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:13:52 devstack sudo[81833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:52 devstack sudo[81833]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:52 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.474s {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:52 devstack cinder-volume[81753]: INFO cinder.volume.manager [None req-dd96fdbe-8a90-41ca-8b0b-96b54c7c89fd None None] Driver post RPC initialization completed successfully. Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=81753) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG cinder.volume.drivers.quobyte [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=81753) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81753) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:13:55 devstack sudo[81900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:13:55 devstack sudo[81900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:13:55 devstack sudo[81900]: pam_unix(sudo:session): session closed for user root Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG oslo_concurrency.processutils [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.392s {{(pid=81753) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:13:55 devstack cinder-volume[81753]: DEBUG cinder.manager [None req-b7633e9a-8c78-4b6c-97f7-a91c7fab9fd7 None None] Notifying Schedulers of capabilities ... {{(pid=81753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:13:59 devstack cinder-volume[81587]: INFO oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Caught SIGTERM, stopping children Apr 10 16:13:59 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Acquiring lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:13:59 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Acquired lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:13:59 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Releasing lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:13:59 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Stop services. {{(pid=81587) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 16:13:59 devstack cinder-volume[81587]: DEBUG oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Killing children. {{(pid=81587) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 16:13:59 devstack cinder-volume[81587]: INFO oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Waiting on 1 children to exit Apr 10 16:14:00 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Acquiring lock "singleton_lock" {{(pid=81753) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:14:00 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Acquired lock "singleton_lock" {{(pid=81753) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:14:00 devstack cinder-volume[81753]: DEBUG oslo_concurrency.lockutils [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Releasing lock "singleton_lock" {{(pid=81753) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:14:00 devstack cinder-volume[81753]: WARNING amqp [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 16:14:00 devstack cinder-volume[81753]: WARNING amqp [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 16:14:00 devstack cinder-volume[81587]: INFO oslo_service.backend._eventlet.service [None req-d0bf5d32-f472-414f-a0dd-b92f8ee5a915 None None] Child 81753 exited with status 0 Apr 10 16:14:00 devstack cinder-volume[81975]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 16:14:00 devstack cinder-volume[81975]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 16:14:00 devstack cinder-volume[81975]: we strongly recommend against using it for new projects. Apr 10 16:14:00 devstack cinder-volume[81975]: If you are already using Eventlet, we recommend migrating to a different Apr 10 16:14:00 devstack cinder-volume[81975]: framework. For more detail see Apr 10 16:14:00 devstack cinder-volume[81975]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 16:14:00 devstack cinder-volume[81975]: import eventlet # noqa Apr 10 16:14:02 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 16:14:02 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 16:14:02 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 16:14:02 devstack cinder-volume[81975]: INFO dbcounter [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Registered counter for database cinder Apr 10 16:14:02 devstack cinder-volume[81975]: DEBUG oslo_db.sqlalchemy.engines [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:14:02 devstack cinder-volume[81975]: DEBUG dbcounter [-] [81975] Writer thread running {{(pid=81975) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 16:14:02 devstack cinder-volume[81975]: INFO cinder.rpc [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 16:14:02 devstack cinder-volume[81975]: INFO cinder.rpc [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 16:14:02 devstack cinder-volume[81975]: DEBUG oslo_db.sqlalchemy.engines [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:14:03 devstack cinder-volume[81975]: INFO cinder.volume.manager [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Determined volume DB was empty at startup. Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG cinder.volume.manager [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81975) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 16:14:03 devstack cinder-volume[81975]: WARNING stevedore.named [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 16:14:03 devstack cinder-volume[81975]: WARNING castellan.key_manager [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:14:03 devstack cinder-volume[81975]: WARNING cinder.keymgr.conf_key_mgr [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 16:14:03 devstack cinder-volume[81975]: INFO cinder.volume.manager [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_db.sqlalchemy.engines [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:14:03 devstack cinder-volume[81975]: INFO oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Starting 1 workers Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Started child 82117 {{(pid=81975) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Full set of CONF: {{(pid=81975) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] ******************************************************************************** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Configuration options gathered from: {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] ================================================================================ {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] allow_availability_zone_fallback = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] allow_compression_on_image_upload = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] allowed_direct_url_schemes = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] api_rate_limit = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] auth_strategy = keystone {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_availability_zone = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_host = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_stats_polling_interval = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backup_api_class = cinder.backup.api.API {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backup_name_template = backup-%s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backup_use_same_host = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backup_use_temp_snapshot = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] chap_password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] chap_username = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_internal_tenant_project_id = cad9d5d1fc714c5b93182ff1ca99311d {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_internal_tenant_user_id = 853807623a0f4de48f3902a3799098d8 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cluster = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] compression_format = gzip {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] compute_api_class = cinder.compute.nova.API {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] config_dir = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] config_source = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] control_exchange = openstack {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] debug = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] default_availability_zone = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] default_group_type = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] default_volume_type = QuobyteHD {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] disk_geometry = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] driver_client_cert = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] driver_client_cert_key = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] driver_data_namespace = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] driver_ssl_cert_path = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] driver_ssl_cert_verify = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] driver_use_ssl = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] enable_new_services = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] enable_unsupported_driver = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] enabled_backends = ['QuobyteHD'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] enforce_multipath_for_image_xfer = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] filter_function = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_api_insecure = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_api_servers = ['http://192.168.122.112/image'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_api_ssl_compression = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_ca_certificates_file = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_catalog_info = image:glance:publicURL {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_num_retries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance_request_timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] goodness_function = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] graceful_shutdown_timeout = 5 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] group_api_class = cinder.group.api.API {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] host = devstack {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_compress_on_upload = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_conversion_address_space_limit = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[82117]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_conversion_cpu_limit = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_conversion_disable = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_upload_use_cinder_backend = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_upload_use_internal_tenant = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_volume_cache_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_volume_cache_max_count = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] image_volume_cache_max_size_gb = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] init_host_max_objects_retrieval = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] instance_format = [instance: %(uuid)s] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] iscsi_target_flags = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] iscsi_write_cache = on {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] iser_helper = tgtadm {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] iser_ip_address = 192.168.122.112 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] iser_port = 3260 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_color = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_config_append = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_dir = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_file = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_options = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_rotate_interval = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_rotate_interval_type = days {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] log_rotation_type = none {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] max_age = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] max_logfile_count = 30 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] max_logfile_size_mb = 200 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] max_over_subscription_ratio = 20.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] message_reap_interval = 86400 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] message_ttl = 2592000 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] migration_create_volume_timeout_secs = 300 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] monkey_patch = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] monkey_patch_modules = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] my_ip = 192.168.122.112 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] no_snapshot_gb_quota = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] num_iser_scan_tries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] num_shell_tries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] num_volume_device_scan_tries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] nvmeof_conn_info_version = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] nvmet_ns_id = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] nvmet_port_id = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_max_limit = 1000 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_volume_ext_list = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_volume_listen = 0.0.0.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_volume_listen_port = 8776 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_volume_use_ssl = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] osapi_volume_workers = 2 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] per_volume_size_limit = -1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] periodic_fuzzy_delay = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] periodic_interval = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] project_id_regex = [0-9a-f\-]+ {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] public_endpoint = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] publish_errors = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_backup_gigabytes = 1000 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_backups = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_gigabytes = 1000 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_groups = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_snapshots = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] quota_volumes = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] rate_limit_burst = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] rate_limit_except_level = CRITICAL {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] rate_limit_interval = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] reinit_driver_count = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] replication_device = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] report_discard_supported = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] report_interval = 120 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] reservation_clean_interval = 86400 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] reservation_expire = 86400 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] reserved_image_namespaces = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] reserved_percentage = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] rpc_response_timeout = 120 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] run_external_periodic_tasks = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] scst_target_driver = iscsi {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] scst_target_iqn_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_down_time = 720 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] shell_completion = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] snapshot_name_template = snapshot-%s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] split_loggers = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] state_path = /opt/stack/data/cinder {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] storage_availability_zone = nova {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] storage_protocol = iSCSI {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] syslog_log_facility = LOG_USER {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] target_helper = lioadm {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] target_ip_address = 192.168.122.112 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] target_port = 3260 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] target_protocol = iscsi {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] target_secondary_ip_addresses = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] trace_flags = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] transfer_api_class = cinder.transfer.api.API {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] transport_url = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] until_refresh = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_chap_auth = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_default_quota_class = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_journal = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_json = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_multipath_for_image_xfer = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_stderr = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] use_syslog = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] verify_glance_signatures = enabled {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_api_class = cinder.volume.api.API {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_backend_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_clear = zero {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_clear_ionice = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_clear_size = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_copy_bps_limit = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_dd_blocksize = 1M {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_name_template = volume-%s {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_service_inithost_offload = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volume_usage_audit_period = month {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] zoning_mode = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_concurrency.disable_process_locking = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.admin_password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.admin_token = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.admin_user = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_admin_prefix = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_port = 35357 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_protocol = https {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_section = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_type = password {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_uri = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.auth_version = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.cache = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.delay_auth_decision = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.http_connect_timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.identity_uri = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.include_service_catalog = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.insecure = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.interface = public {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_password = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcache_username = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.region_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.service_token_roles_required = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.service_type = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.token_cache_time = 300 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.112/identity {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.backend = dogpile.cache.null {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.backend_argument = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.backend_expiration_time = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.config_prefix = cache.oslo {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.debug_cache_backend = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.enable_retry_client = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.enable_socket_keepalive = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.enforce_fips_mode = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.expiration_time = 600 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.hashclient_retry_attempts = 2 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_dead_retry = 300 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_pool_maxsize = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_sasl_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.proxies = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.redis_db = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.redis_sentinel_service_name = mymaster {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.redis_server = localhost:6379 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.retry_attempts = 2 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.retry_delay = 0.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.socket_keepalive_count = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.socket_keepalive_idle = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.socket_keepalive_interval = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.socket_timeout = 1.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.tls_allowed_ciphers = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.tls_cafile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.tls_certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.tls_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.tls_keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cache.username = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] coordination.backend_url = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.asyncio_connection = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.asyncio_slave_connection = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.backend = sqlalchemy {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.connection = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.connection_debug = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.connection_parameters = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.connection_recycle_time = 3600 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.connection_trace = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.db_inc_retry_interval = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.db_max_retries = 20 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.db_max_retry_interval = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.db_retry_interval = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82117) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.max_overflow = 50 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.max_pool_size = 5 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.max_retries = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.mysql_wsrep_sync_wait = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.pool_timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.retry_interval = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.slave_connection = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.sqlite_synchronous = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.synchronous_reader = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] database.use_db_reconnect = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.connection_string = messaging:// {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.es_doc_type = notification {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.es_scroll_size = 10000 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.es_scroll_time = 2m {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.filter_error_trace = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.hmac_keys = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.sentinel_service_name = mymaster {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.socket_timeout = 0.1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.trace_requests = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler.trace_sqlalchemy = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler_jaeger.process_tags = {} {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler_jaeger.service_name_prefix = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] profiler_otlp.service_name_prefix = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.enforce_new_defaults = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: WARNING oslo_config.cfg [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.enforce_scope = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.policy_default_rule = default {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.policy_file = policy.yaml {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_policy.remote_timeout = 60.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.group = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.helper_command = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] privsep_osbrick.user = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.group = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.helper_command = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] cinder_sys_admin.user = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.auth_section = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.auth_type = password {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.cafile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.collect_timing = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.insecure = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.send_service_user_token = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.split_loggers = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] service_user.timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.auth_section = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.auth_type = password {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.collect_timing = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.insecure = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.region_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.split_loggers = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] glance.timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.backend_availability_zone = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.chap_password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.chap_username = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.disk_geometry = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.driver_client_cert = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.driver_client_cert_key = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.driver_data_namespace = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.driver_use_ssl = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.enable_unsupported_driver = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.extra_capabilities = {} {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.filter_function = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.goodness_function = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.iscsi_target_flags = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.iscsi_write_cache = on {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.iser_helper = tgtadm {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.iser_ip_address = 192.168.122.112 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.iser_port = 3260 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_host = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_login = admin {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_mount_options = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_private_key = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_share_path = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_ssh_port = 22 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.num_shell_tries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.nvmet_port_id = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_client_cfg = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.quobyte_volume_url = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.replication_device = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.report_discard_supported = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.reserved_percentage = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.scst_target_driver = iscsi {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.scst_target_iqn_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.storage_protocol = iSCSI {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.target_helper = tgtadm {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.target_ip_address = 192.168.122.112 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.target_port = 3260 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.target_protocol = iscsi {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.trace_flags = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.unique_fqdn_network = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.use_chap_auth = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_backend_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_clear = zero {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_clear_ionice = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_clear_size = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_reports.file_event_handler = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_reports.log_dir = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.backend_availability_zone = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.backend_host = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.chap_password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.chap_username = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.chiscsi_conf = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.disk_geometry = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.driver_client_cert = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.driver_client_cert_key = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.driver_data_namespace = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.driver_use_ssl = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.extra_capabilities = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.filter_function = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.goodness_function = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.iscsi_target_flags = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.iscsi_write_cache = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.iser_helper = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.iser_ip_address = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.iser_port = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.iser_target_prefix = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_host = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_login = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_mount_options = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_password = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_private_key = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_share_path = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_ssh_port = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.num_shell_tries = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nvmet_ns_id = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.nvmet_port_id = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.replication_device = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.report_discard_supported = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.reserved_percentage = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.scst_target_driver = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.storage_protocol = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.target_helper = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.target_ip_address = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.target_port = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.target_prefix = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.target_protocol = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.trace_flags = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.unique_fqdn_network = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.use_chap_auth = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_clear = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_clear_ionice = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_clear_size = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] QuobyteHD.volumes_dir = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.ssl = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.ssl_version = {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_notifications.driver = [] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_notifications.retry = -1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] oslo_messaging_notifications.transport_url = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] key_manager.fixed_key = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.barbican_api_version = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.barbican_endpoint = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.barbican_endpoint_type = public {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.barbican_region_name = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.cafile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.collect_timing = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.insecure = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.number_of_retries = 60 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.retry_delay = 1 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.send_service_user_token = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.split_loggers = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.verify_ssl = True {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican.verify_ssl_path = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.auth_section = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.auth_type = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.cafile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.certfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.collect_timing = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.insecure = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.keyfile = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.split_loggers = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] barbican_service_user.timeout = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.approle_role_id = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.approle_secret_id = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.kv_mountpoint = secret {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.kv_path = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.kv_version = 2 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.namespace = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.root_token_id = **** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.ssl_ca_crt_file = None {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.timeout = 60.0 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.use_ssl = False {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 16:14:03 devstack cinder-volume[81975]: DEBUG oslo_service.backend._eventlet.service [None req-dd2ffb8e-b347-4089-bf7f-90e368a06e0f None None] ******************************************************************************** {{(pid=81975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82117) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 16:14:03 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 16:14:03 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Running cmd (subprocess): mount.quobyte {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:14:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:14:03 devstack sudo[82123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:14:03 devstack sudo[82123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:14:04 devstack sudo[82123]: pam_unix(sudo:session): session closed for user root Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.912s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:14:04 devstack cinder-volume[82117]: INFO cinder.volume.driver [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Driver hasn't implemented _init_vendor_properties() Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.volume.driver [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82117) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82117) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writer thread running {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.db.sqlalchemy.api [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Building query based on filter {{(pid=82117) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82117) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:14:04 devstack cinder-volume[82117]: INFO cinder.keymgr.migration [None req-3a89454e-afd4-4d6c-bf86-4e601bc90d56 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 16:14:04 devstack sudo[82208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:14:04 devstack sudo[82208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:14:04 devstack sudo[82208]: pam_unix(sudo:session): session closed for user root Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.447s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:14:04 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Driver initialization completed successfully. Apr 10 16:14:04 devstack cinder-volume[82117]: INFO cinder.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Initiating service 3 cleanup Apr 10 16:14:04 devstack cinder-volume[82117]: INFO cinder.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Service 3 cleanup completed. Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.service [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Creating RPC server for service cinder-volume {{(pid=82117) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.service [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82117) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 16:14:04 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:14:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:14:04 devstack sudo[82224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:14:04 devstack sudo[82224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:14:05 devstack sudo[82224]: pam_unix(sudo:session): session closed for user root Apr 10 16:14:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.384s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:14:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d8b5d925-88ba-403d-8011-bf05f5b0658c None None] Driver post RPC initialization completed successfully. Apr 10 16:14:13 devstack cinder-volume[81975]: DEBUG dbcounter [-] [81975] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81975) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:14:14 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:14:15 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=3 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:15:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Flow 'volume_create_manager' (50919942-fa06-41d6-b0b5-50a8b42cd596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205223dc-4b9d-4b89-861e-d46f7684629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205223dc-4b9d-4b89-861e-d46f7684629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-221824091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7762958-2c32-4b89-b37c-b9362e5bd199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7155541d0647d5a7acb6f3b7b9b331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:05Z,use_quota=True,user_id='aea3b1c331d74cbdaa246b5bf946ed41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b8df0d-ab18-4ac7-86ce-90a6ca487029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b8df0d-ab18-4ac7-86ce-90a6ca487029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81cf737c-305a-47f3-bbc3-e2625cf94c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81cf737c-305a-47f3-bbc3-e2625cf94c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7762958-2c32-4b89-b37c-b9362e5bd199', 'volume_name': 'volume-d7762958-2c32-4b89-b37c-b9362e5bd199', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dbceff-56ea-486a-891f-4c3cb413556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dbceff-56ea-486a-891f-4c3cb413556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c95983b-1a77-4dba-a3f0-0335ffac376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Volume d7762958-2c32-4b89-b37c-b9362e5bd199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7762958-2c32-4b89-b37c-b9362e5bd199', 'volume_size': 1} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-221824091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7762958-2c32-4b89-b37c-b9362e5bd199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7155541d0647d5a7acb6f3b7b9b331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:05Z,use_quota=True,user_id='aea3b1c331d74cbdaa246b5bf946ed41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Creating volume d7762958-2c32-4b89-b37c-b9362e5bd199 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:05 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:05 devstack sudo[82637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 1073741824 Apr 10 16:15:05 devstack sudo[82637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Flow 'volume_create_manager' (978d07ee-3734-4662-92c0-1525bbac7170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4506fb-5b86-4cc6-9aeb-fc23a3371b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4506fb-5b86-4cc6-9aeb-fc23a3371b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1718716789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77ebbe1-6c43-4678-a858-bcdcab346dd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffbeafa8938742249811e2cf2e4bf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:05Z,use_quota=True,user_id='ad86e8ae48eb45f79e97b6517f0ea327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1b5867-2eee-4744-9cfc-6bde54511b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1b5867-2eee-4744-9cfc-6bde54511b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecf3af9-68fc-46e8-8210-2eccd83dfc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecf3af9-68fc-46e8-8210-2eccd83dfc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77ebbe1-6c43-4678-a858-bcdcab346dd6', 'volume_name': 'volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bdf6ce-3652-4ae5-8a4f-8775001c25f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bdf6ce-3652-4ae5-8a4f-8775001c25f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3541800a-4319-40c7-b062-a75efe1421ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Volume b77ebbe1-6c43-4678-a858-bcdcab346dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6', 'volume_size': 1} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Flow 'volume_create_manager' (20d762f6-a1da-46b9-82f5-8e0a86a5f421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f8a2e-7b88-4db5-b029-4c778184c0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f8a2e-7b88-4db5-b029-4c778184c0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1950844748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92378a7f-be90-4cb0-96e5-046d8c1f4186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233df13206d046b2ab0e64234af2e553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:05Z,use_quota=True,user_id='66196eb207cb413f80f9207ef8365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae9a792-c158-465a-9197-71d11bad3ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae9a792-c158-465a-9197-71d11bad3ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ad04bf-32c6-4751-bb57-793ef50ff456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ad04bf-32c6-4751-bb57-793ef50ff456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92378a7f-be90-4cb0-96e5-046d8c1f4186', 'volume_name': 'volume-92378a7f-be90-4cb0-96e5-046d8c1f4186', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf77cf28-df73-4dfa-b201-a6cc74b83922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf77cf28-df73-4dfa-b201-a6cc74b83922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7826e793-ea64-4f10-a40b-da51a6ae2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Volume 92378a7f-be90-4cb0-96e5-046d8c1f4186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92378a7f-be90-4cb0-96e5-046d8c1f4186', 'volume_size': 1} Apr 10 16:15:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:06 devstack sudo[82637]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 1073741824" returned: 0 in 1.061s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:06 devstack sudo[82957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 Apr 10 16:15:06 devstack sudo[82957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:07 devstack sudo[82957]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199" returned: 0 in 0.922s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1718716789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77ebbe1-6c43-4678-a858-bcdcab346dd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffbeafa8938742249811e2cf2e4bf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:05Z,use_quota=True,user_id='ad86e8ae48eb45f79e97b6517f0ea327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Creating volume b77ebbe1-6c43-4678-a858-bcdcab346dd6 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:07 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c95983b-1a77-4dba-a3f0-0335ffac376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7762958-2c32-4b89-b37c-b9362e5bd199', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2f282d-7cf1-4f59-9850-32eda9f566fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:07 devstack sudo[82968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 1073741824 Apr 10 16:15:07 devstack sudo[82968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:07 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Volume volume-d7762958-2c32-4b89-b37c-b9362e5bd199 (d7762958-2c32-4b89-b37c-b9362e5bd199): created successfully Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2f282d-7cf1-4f59-9850-32eda9f566fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Flow 'volume_create_manager' (50919942-fa06-41d6-b0b5-50a8b42cd596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:07 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-837c3536-5b4a-4063-861e-72efc276e5d3 tempest-VolumesAdminNegativeTest-737482303 None] Created volume successfully. Apr 10 16:15:07 devstack sudo[82968]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 1073741824" returned: 0 in 0.752s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:08 devstack sudo[82975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 Apr 10 16:15:08 devstack sudo[82975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:08 devstack sudo[82975]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6" returned: 0 in 0.575s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.906s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1950844748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92378a7f-be90-4cb0-96e5-046d8c1f4186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233df13206d046b2ab0e64234af2e553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:05Z,use_quota=True,user_id='66196eb207cb413f80f9207ef8365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Creating volume 92378a7f-be90-4cb0-96e5-046d8c1f4186 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:08 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3541800a-4319-40c7-b062-a75efe1421ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe55c9e-f179-4cc8-bbd1-40eeed80e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:08 devstack sudo[82978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 1073741824 Apr 10 16:15:08 devstack sudo[82978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:08 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Volume volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 (b77ebbe1-6c43-4678-a858-bcdcab346dd6): created successfully Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe55c9e-f179-4cc8-bbd1-40eeed80e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Flow 'volume_create_manager' (978d07ee-3734-4662-92c0-1525bbac7170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:08 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-53277251-e31e-49fd-b105-610f76bd0f9e req-67e70f55-bbf4-45a8-a5e7-cdce85363afc tempest-VolumesGetTestJSON-1362980419 None] Created volume successfully. Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Acquiring lock "cinder-d7762958-2c32-4b89-b37c-b9362e5bd199-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Lock "cinder-d7762958-2c32-4b89-b37c-b9362e5bd199-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Acquiring lock "cinder-quobyte-d7762958-2c32-4b89-b37c-b9362e5bd199" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Lock "cinder-quobyte-d7762958-2c32-4b89-b37c-b9362e5bd199" acquired by "delete_volume" :: waited 0.026s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:08 devstack cinder-volume[82117]: INFO oslo.privsep.daemon [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3ybrucx4/privsep.sock'] Apr 10 16:15:08 devstack sudo[82992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3ybrucx4/privsep.sock Apr 10 16:15:08 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Acquiring lock "cinder-b77ebbe1-6c43-4678-a858-bcdcab346dd6-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Lock "cinder-b77ebbe1-6c43-4678-a858-bcdcab346dd6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Acquiring lock "cinder-quobyte-b77ebbe1-6c43-4678-a858-bcdcab346dd6" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 16:15:09 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 16:15:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Lock "cinder-quobyte-b77ebbe1-6c43-4678-a858-bcdcab346dd6" acquired by "delete_volume" :: waited 0.032s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:09 devstack sudo[82978]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 1073741824" returned: 0 in 1.197s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:09 devstack sudo[83026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 Apr 10 16:15:09 devstack sudo[83026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 16:15:10 devstack sudo[83026]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186" returned: 0 in 0.606s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7826e793-ea64-4f10-a40b-da51a6ae2888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92378a7f-be90-4cb0-96e5-046d8c1f4186', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f11ef94-9ec7-4a36-8029-230d46e5072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:10 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Volume volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 (92378a7f-be90-4cb0-96e5-046d8c1f4186): created successfully Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f11ef94-9ec7-4a36-8029-230d46e5072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Flow 'volume_create_manager' (20d762f6-a1da-46b9-82f5-8e0a86a5f421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:10 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ff37e0a8-9703-4fb1-88e7-45bfb8cfe44c tempest-DeleteServersTestJSON-1502595254 None] Created volume successfully. Apr 10 16:15:10 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:10 devstack cinder-volume[82117]: INFO oslo.privsep.daemon [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Spawned new privsep daemon via rootwrap Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Accepted privsep connection to /tmp/tmp3ybrucx4/privsep.sock {{(pid=82117) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 16:15:10 devstack cinder-volume[82117]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 16:15:10 devstack cinder-volume[82117]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 16:15:10 devstack cinder-volume[82117]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 16:15:10 devstack cinder-volume[82117]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83033 Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4cd78c-4a6e-4f14-b3f1-30d25ebea290]: (2,) {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:10 devstack cinder-volume[82117]: WARNING oslo_privsep.priv_context [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] privsep daemon already running Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb4e9a-9f02-4001-936e-fc2cabb0f7f7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e4906-2ff8-4293-b068-af005a98f5ae]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:10 devstack sudo[83037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 Apr 10 16:15:10 devstack sudo[83037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:10 devstack sudo[83036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 Apr 10 16:15:10 devstack sudo[83036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:11 devstack sudo[83037]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6" returned: 0 in 0.557s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:11 devstack sudo[83046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6 Apr 10 16:15:11 devstack sudo[83046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:11 devstack sudo[83036]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199" returned: 0 in 0.828s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:11 devstack sudo[83056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199 Apr 10 16:15:11 devstack sudo[83056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:11 devstack sudo[83046]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b77ebbe1-6c43-4678-a858-bcdcab346dd6" returned: 0 in 0.563s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Lock "cinder-quobyte-b77ebbe1-6c43-4678-a858-bcdcab346dd6" released by "delete_volume" :: held 2.198s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:11 devstack cinder-volume[82117]: WARNING cinder.quota [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:15:11 devstack cinder-volume[82117]: WARNING cinder.quota [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG cinder.quota [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Created reservations ['4cd09427-212c-4f73-9f16-fdcc8cef22af', '99b59ff6-5d97-4d6e-8fd4-7c6fb7a701a6', '52a7a747-abcd-4180-93d9-e122d04a59d6', 'ab966f44-5433-45cd-916f-948c152b5737'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:11 devstack sudo[83056]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d7762958-2c32-4b89-b37c-b9362e5bd199" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:12 devstack sudo[83062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:12 devstack sudo[83062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Lock "cinder-quobyte-d7762958-2c32-4b89-b37c-b9362e5bd199" released by "delete_volume" :: held 3.071s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Created reservations ['fd0943ab-826c-4210-a2ce-97db080d3034', 'f0355bcc-b431-466d-a183-7c0c206e124b', '82971514-7eef-4cf4-8ebc-9664a6107f2d', 'bf9978fc-c99b-4e05-bd73-9a0a67f85a81'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:12 devstack sudo[83064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:12 devstack sudo[83064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:12 devstack sudo[83064]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.505s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Deleted volume successfully. Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3098d6dd-0aef-405f-a476-ab021f6f5310 tempest-VolumesAdminNegativeTest-737482303 None] Lock "cinder-d7762958-2c32-4b89-b37c-b9362e5bd199-delete_volume" released by "delete_volume" :: held 3.811s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:12 devstack sudo[83062]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.841s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.manager [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Deleted volume successfully. Apr 10 16:15:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-f9df142f-2d1b-4684-8fc9-8d0c5459e232 req-48724ec2-8892-482b-987c-9838bf4d4f38 tempest-VolumesGetTestJSON-1362980419 None] Lock "cinder-b77ebbe1-6c43-4678-a858-bcdcab346dd6-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:15 devstack sudo[83106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:15 devstack sudo[83106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:16 devstack sudo[83106]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.951s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:16 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:17 devstack cinder-volume[82117]: WARNING py.warnings [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 10 16:15:17 devstack cinder-volume[82117]: .first() Apr 10 16:15:17 devstack cinder-volume[82117]: Apr 10 16:15:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:17 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd4748f-191c-4ee1-b447-7ca03ff1cf13]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:17 devstack sudo[83140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 Apr 10 16:15:17 devstack sudo[83140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:18 devstack sudo[83140]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186" returned: 0 in 0.729s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.739s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79', 'name': 'volume-92378a7f-be90-4cb0-96e5-046d8c1f4186', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95d0244c-7efa-47cd-83d0-d060fac992d2', 'enforce_multipath': True} {{(pid=82117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 16:15:18 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-1cccb6a8-0790-4410-9758-5fc0964faa57 req-999824f7-fe1e-42dd-83e5-a0ca5946cf21 tempest-DeleteServersTestJSON-1502595254 None] attachment_update completed successfully. Apr 10 16:15:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3a011f2a-2ac7-44de-ae46-1dad12b0be57 tempest-GroupsTest-1697654237 None] Group tempest-Group1-179862926: creating Apr 10 16:15:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3a011f2a-2ac7-44de-ae46-1dad12b0be57 tempest-GroupsTest-1697654237 None] Group tempest-Group1-179862926: created successfully Apr 10 16:15:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3a011f2a-2ac7-44de-ae46-1dad12b0be57 tempest-GroupsTest-1697654237 None] Create group completed successfully. Apr 10 16:15:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c50a22f7-241d-442e-80a0-6ca6ad761517 tempest-GroupsTest-1697654237 None] Group tempest-Group2-1600920604: creating Apr 10 16:15:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-d9e25522-1546-43a1-abcd-4e0b5bffd0b6 req-5f006baa-50cb-45a6-bcc7-5a4332995c51 tempest-DeleteServersTestJSON-1502595254 None] Terminate volume connection completed successfully. Apr 10 16:15:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-d9e25522-1546-43a1-abcd-4e0b5bffd0b6 req-5f006baa-50cb-45a6-bcc7-5a4332995c51 tempest-DeleteServersTestJSON-1502595254 None] Deleting attachment 95d0244c-7efa-47cd-83d0-d060fac992d2. {{(pid=82117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 16:15:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c50a22f7-241d-442e-80a0-6ca6ad761517 tempest-GroupsTest-1697654237 None] Group tempest-Group2-1600920604: created successfully Apr 10 16:15:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c50a22f7-241d-442e-80a0-6ca6ad761517 tempest-GroupsTest-1697654237 None] Create group completed successfully. Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Flow 'volume_create_manager' (7a6d4889-dc6e-4146-8d61-cc88f6035b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83252474-e79c-4f90-9902-6deee97c8387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83252474-e79c-4f90-9902-6deee97c8387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613689328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8da4bdc-20c9-45cd-bfb6-b806173be2db,host='devstack@QuobyteHD#QuobyteHD',id=9de82f29-f12a-4d88-8a7f-f2525b033eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862a6fb6e001426faa0de1ba9d793965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:28Z,use_quota=True,user_id='b73f225fdb174faa9bac552b81be58c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f723731-1cfc-4c0c-af11-aae60e21ffc5),volume_type_id=5f723731-1cfc-4c0c-af11-aae60e21ffc5)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54467da5-12cd-461b-9bdd-3d51ecc67fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54467da5-12cd-461b-9bdd-3d51ecc67fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d8591c-373c-4aaf-a39d-ff701f690d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d8591c-373c-4aaf-a39d-ff701f690d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de82f29-f12a-4d88-8a7f-f2525b033eac', 'volume_name': 'volume-9de82f29-f12a-4d88-8a7f-f2525b033eac', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c4d1c9-abb7-435c-bc4f-bef9271b7a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c4d1c9-abb7-435c-bc4f-bef9271b7a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e3be9-0a3f-45d4-bb7b-8c4921d80228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:28 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Volume 9de82f29-f12a-4d88-8a7f-f2525b033eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de82f29-f12a-4d88-8a7f-f2525b033eac', 'volume_size': 1} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f8da4bdc-20c9-45cd-bfb6-b806173be2db,created_at=2026-04-10T14:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613689328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8da4bdc-20c9-45cd-bfb6-b806173be2db,host='devstack@QuobyteHD#QuobyteHD',id=9de82f29-f12a-4d88-8a7f-f2525b033eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862a6fb6e001426faa0de1ba9d793965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:28Z,use_quota=True,user_id='b73f225fdb174faa9bac552b81be58c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f723731-1cfc-4c0c-af11-aae60e21ffc5),volume_type_id=5f723731-1cfc-4c0c-af11-aae60e21ffc5)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Creating volume 9de82f29-f12a-4d88-8a7f-f2525b033eac {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:28 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:28 devstack sudo[83632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac 1073741824 Apr 10 16:15:28 devstack sudo[83632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:28 devstack sudo[83632]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac 1073741824" returned: 0 in 0.529s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:28 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac Apr 10 16:15:28 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:29 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac" returned: 0 in 0.593s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e3be9-0a3f-45d4-bb7b-8c4921d80228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de82f29-f12a-4d88-8a7f-f2525b033eac', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534db52-476c-4a2f-8e21-565c20165fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Volume volume-9de82f29-f12a-4d88-8a7f-f2525b033eac (9de82f29-f12a-4d88-8a7f-f2525b033eac): created successfully Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534db52-476c-4a2f-8e21-565c20165fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Flow 'volume_create_manager' (7a6d4889-dc6e-4146-8d61-cc88f6035b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3c15b11b-fb37-4783-bd37-ecc37f11946a tempest-GroupsTest-1697654237 None] Created volume successfully. Apr 10 16:15:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Acquiring lock "cinder-92378a7f-be90-4cb0-96e5-046d8c1f4186-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Lock "cinder-92378a7f-be90-4cb0-96e5-046d8c1f4186-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Acquiring lock "cinder-quobyte-92378a7f-be90-4cb0-96e5-046d8c1f4186" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Lock "cinder-quobyte-92378a7f-be90-4cb0-96e5-046d8c1f4186" acquired by "delete_volume" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7276f44-937e-4dcc-ad9c-bc0a4eb29158]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:30 devstack sudo[83675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 Apr 10 16:15:30 devstack sudo[83675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Acquiring lock "cinder-quobyte-9de82f29-f12a-4d88-8a7f-f2525b033eac" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Lock "cinder-quobyte-9de82f29-f12a-4d88-8a7f-f2525b033eac" acquired by "delete_volume" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[470fb569-1f3f-4f0e-8c19-e67e110c8221]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:31 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac Apr 10 16:15:31 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:31 devstack sudo[83675]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186" returned: 0 in 0.726s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:31 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186 Apr 10 16:15:31 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:31 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac" returned: 0 in 0.762s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:31 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac Apr 10 16:15:31 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:32 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92378a7f-be90-4cb0-96e5-046d8c1f4186" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Lock "cinder-quobyte-92378a7f-be90-4cb0-96e5-046d8c1f4186" released by "delete_volume" :: held 1.287s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Created reservations ['241f5602-f870-4e2f-b123-6c706adfbcee', 'c9ab8719-88af-4760-a6e9-46d2e84df15f', '0a406e97-280d-40ff-8839-619b113df0ae', 'f5c4c540-42f1-4026-8771-af5bc600630f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:32 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:32 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:32 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9de82f29-f12a-4d88-8a7f-f2525b033eac" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Lock "cinder-quobyte-9de82f29-f12a-4d88-8a7f-f2525b033eac" released by "delete_volume" :: held 1.396s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Created reservations ['d8fb8970-8edc-4735-93e4-2441c56f9de3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:32 devstack cinder-volume[82117]: WARNING cinder.quota [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-987131578 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-987131578, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:15:32 devstack cinder-volume[82117]: WARNING cinder.quota [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-987131578 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-987131578, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Created reservations ['b9095713-e6b1-4f15-8280-d673993baebb', '78d50562-9a89-42b3-bd87-3e82c847cb42', 'e067447c-1b71-4417-bd98-3b2ab5245fdc', 'd91b218a-a130-4e83-8549-68f533b7e75b'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:32 devstack sudo[83695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:32 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:32 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.558s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:32 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Deleted volume successfully. Apr 10 16:15:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-dd864574-1aa2-4a55-bda3-9e7b371e38b7 tempest-DeleteServersTestJSON-1502595254 None] Lock "cinder-92378a7f-be90-4cb0-96e5-046d8c1f4186-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:33 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.680s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5b2da90f-e924-41b1-8e2a-e296b34c5419 tempest-GroupsTest-1697654237 None] Delete group completed successfully. Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Created reservations ['94794fc7-3332-4958-a78d-c0282b971a3b'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:33 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:33 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:34 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.603s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:34 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b3c5919e-904f-4603-9298-edc46687aaf6 tempest-GroupsTest-1697654237 None] Delete group completed successfully. Apr 10 16:15:35 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0d0cf860-6f5a-443e-8239-639770a6bda8 tempest-GroupsTest-1697654237 None] Group tempest-GroupsTest-Group-161913568: creating Apr 10 16:15:35 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0d0cf860-6f5a-443e-8239-639770a6bda8 tempest-GroupsTest-1697654237 None] Group tempest-GroupsTest-Group-161913568: created successfully Apr 10 16:15:35 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0d0cf860-6f5a-443e-8239-639770a6bda8 tempest-GroupsTest-1697654237 None] Create group completed successfully. Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Flow 'volume_create_manager' (2bdb64d0-6243-43e8-9062-5451675da8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4084f5-4a30-430c-a35b-b69636571655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4084f5-4a30-430c-a35b-b69636571655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1874876748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84f7931a-2b39-4677-8dd7-a780cc96adad,host='devstack@QuobyteHD#QuobyteHD',id=dfa233d3-65cb-4515-813d-1e88c4598827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862a6fb6e001426faa0de1ba9d793965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:37Z,use_quota=True,user_id='b73f225fdb174faa9bac552b81be58c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df145456-f278-4645-aaf1-4f507405caac),volume_type_id=df145456-f278-4645-aaf1-4f507405caac)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f78c02b-b53b-44d6-92fa-cd9be854ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f78c02b-b53b-44d6-92fa-cd9be854ca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19da22b-0c4e-4d52-a8b0-943175108015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19da22b-0c4e-4d52-a8b0-943175108015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa233d3-65cb-4515-813d-1e88c4598827', 'volume_name': 'volume-dfa233d3-65cb-4515-813d-1e88c4598827', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6361b06-57b7-4d5a-9d30-db0af5bc4907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6361b06-57b7-4d5a-9d30-db0af5bc4907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c751e7-f126-44a2-8a80-9fa7487d8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:36 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Volume dfa233d3-65cb-4515-813d-1e88c4598827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa233d3-65cb-4515-813d-1e88c4598827', 'volume_size': 1} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84f7931a-2b39-4677-8dd7-a780cc96adad,created_at=2026-04-10T14:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1874876748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84f7931a-2b39-4677-8dd7-a780cc96adad,host='devstack@QuobyteHD#QuobyteHD',id=dfa233d3-65cb-4515-813d-1e88c4598827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862a6fb6e001426faa0de1ba9d793965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:37Z,use_quota=True,user_id='b73f225fdb174faa9bac552b81be58c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df145456-f278-4645-aaf1-4f507405caac),volume_type_id=df145456-f278-4645-aaf1-4f507405caac)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Creating volume dfa233d3-65cb-4515-813d-1e88c4598827 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:36 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:37 devstack sudo[83709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 1073741824 Apr 10 16:15:37 devstack sudo[83709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:37 devstack sudo[83709]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 1073741824" returned: 0 in 0.714s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:37 devstack sudo[83715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 Apr 10 16:15:37 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:38 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827" returned: 0 in 0.820s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c751e7-f126-44a2-8a80-9fa7487d8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa233d3-65cb-4515-813d-1e88c4598827', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf41974-5209-4eda-b0be-5fc23c627c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:38 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Volume volume-dfa233d3-65cb-4515-813d-1e88c4598827 (dfa233d3-65cb-4515-813d-1e88c4598827): created successfully Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf41974-5209-4eda-b0be-5fc23c627c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Flow 'volume_create_manager' (2bdb64d0-6243-43e8-9062-5451675da8e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-08ccad0e-daa7-4e41-8a22-79ed3dc00b42 tempest-GroupsTest-1697654237 None] Created volume successfully. Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Flow 'volume_create_manager' (481b92ca-889a-418f-8b3f-a3b2b9794813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b31c657-4b28-4860-a618-993360e7e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b31c657-4b28-4860-a618-993360e7e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1510427750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84f7931a-2b39-4677-8dd7-a780cc96adad,host='devstack@QuobyteHD#QuobyteHD',id=e25b2605-1dd9-4a46-b6a2-71dc81985ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862a6fb6e001426faa0de1ba9d793965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:40Z,use_quota=True,user_id='b73f225fdb174faa9bac552b81be58c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df145456-f278-4645-aaf1-4f507405caac),volume_type_id=df145456-f278-4645-aaf1-4f507405caac)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5948dc-2a36-4686-9ec2-cdcf217b4cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5948dc-2a36-4686-9ec2-cdcf217b4cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4517f714-a866-42ba-9ade-1d76aedf276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4517f714-a866-42ba-9ade-1d76aedf276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25b2605-1dd9-4a46-b6a2-71dc81985ec3', 'volume_name': 'volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f08cab-542f-49b6-806a-2ae7db56b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f08cab-542f-49b6-806a-2ae7db56b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba757d3-faef-4553-90f1-d7265ce56ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:39 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Volume e25b2605-1dd9-4a46-b6a2-71dc81985ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3', 'volume_size': 1} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84f7931a-2b39-4677-8dd7-a780cc96adad,created_at=2026-04-10T14:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1510427750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84f7931a-2b39-4677-8dd7-a780cc96adad,host='devstack@QuobyteHD#QuobyteHD',id=e25b2605-1dd9-4a46-b6a2-71dc81985ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862a6fb6e001426faa0de1ba9d793965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:40Z,use_quota=True,user_id='b73f225fdb174faa9bac552b81be58c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df145456-f278-4645-aaf1-4f507405caac),volume_type_id=df145456-f278-4645-aaf1-4f507405caac)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Creating volume e25b2605-1dd9-4a46-b6a2-71dc81985ec3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:40 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:40 devstack sudo[83720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 1073741824 Apr 10 16:15:40 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Flow 'volume_create_manager' (f9a36f40-da91-4fc7-9aee-5556b6d2211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81bb3bf-291f-4945-8753-d1d3595c0cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81bb3bf-291f-4945-8753-d1d3595c0cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:40Z,deleted=False,deleted_at=None,display_description='',display_name='0b5881d2-089c-429e-8eee-a93fd16d62d8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ba264-e6f6-4cd2-b31b-1c07f811f5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fbe225aaf484fb9bd28878fe70e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:41Z,use_quota=True,user_id='6fd91ab345ec470eacce67c6c20e633a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7a9765-aeb5-49e4-a340-8397182d1f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7a9765-aeb5-49e4-a340-8397182d1f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd5c7c6-4919-4a73-aa2d-4b31f3d22791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd5c7c6-4919-4a73-aa2d-4b31f3d22791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287ba264-e6f6-4cd2-b31b-1c07f811f5ca', 'volume_name': 'volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed034b01-9a18-4f96-9ceb-36ef0e40346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed034b01-9a18-4f96-9ceb-36ef0e40346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77543671-ff6c-4db9-9408-6d5c66666a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Volume 287ba264-e6f6-4cd2-b31b-1c07f811f5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca', 'volume_size': 1} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Flow 'volume_create_manager' (4bfc9acc-8945-41cf-954a-9b031577118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b77427d-9d60-4327-a593-f0b1abc9b060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b77427d-9d60-4327-a593-f0b1abc9b060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-583659440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1238fbb-3398-4ce4-b806-530f4eb8836b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa13bd868c144741bf4c13f32c8b88ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:41Z,use_quota=True,user_id='7b8b1fc6127a4c8287853b4e8abb6fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae410e82-c37e-4332-9b56-cc92eb5de800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae410e82-c37e-4332-9b56-cc92eb5de800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611a215a-2843-40e4-937d-07ad2645b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611a215a-2843-40e4-937d-07ad2645b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1238fbb-3398-4ce4-b806-530f4eb8836b', 'volume_name': 'volume-e1238fbb-3398-4ce4-b806-530f4eb8836b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447c536-637e-4e65-9d26-c6a0d9aad63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447c536-637e-4e65-9d26-c6a0d9aad63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387a3282-8db0-4631-b7d8-63372997fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Volume e1238fbb-3398-4ce4-b806-530f4eb8836b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1238fbb-3398-4ce4-b806-530f4eb8836b', 'volume_size': 1} Apr 10 16:15:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:41 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 1073741824" returned: 0 in 1.001s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:41 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 Apr 10 16:15:41 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:41 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3" returned: 0 in 0.548s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:40Z,deleted=False,deleted_at=None,display_description='',display_name='0b5881d2-089c-429e-8eee-a93fd16d62d8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ba264-e6f6-4cd2-b31b-1c07f811f5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fbe225aaf484fb9bd28878fe70e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:41Z,use_quota=True,user_id='6fd91ab345ec470eacce67c6c20e633a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Creating volume 287ba264-e6f6-4cd2-b31b-1c07f811f5ca {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:41 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba757d3-faef-4553-90f1-d7265ce56ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7379ca-93c8-4427-bdd1-2d4058d49f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:41 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Volume volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 (e25b2605-1dd9-4a46-b6a2-71dc81985ec3): created successfully Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7379ca-93c8-4427-bdd1-2d4058d49f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Flow 'volume_create_manager' (481b92ca-889a-418f-8b3f-a3b2b9794813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:41 devstack sudo[83733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca 1073741824 Apr 10 16:15:41 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e87f528b-e2e4-4b9c-bff5-023b8c283bce tempest-GroupsTest-1697654237 None] Created volume successfully. Apr 10 16:15:42 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca 1073741824" returned: 0 in 0.687s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:42 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca Apr 10 16:15:42 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:42 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3a8fa90d-6508-4147-a43a-39d21cc305a0 tempest-GroupsTest-1697654237 None] Update group completed successfully. Apr 10 16:15:42 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" returned: 0 in 0.590s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.148s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-583659440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1238fbb-3398-4ce4-b806-530f4eb8836b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa13bd868c144741bf4c13f32c8b88ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:41Z,use_quota=True,user_id='7b8b1fc6127a4c8287853b4e8abb6fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Creating volume e1238fbb-3398-4ce4-b806-530f4eb8836b {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:42 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77543671-ff6c-4db9-9408-6d5c66666a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e53562c-e3e1-4eb7-b812-a1564b39eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:42 devstack sudo[83745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b 1073741824 Apr 10 16:15:42 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:42 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Volume volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca (287ba264-e6f6-4cd2-b31b-1c07f811f5ca): created successfully Apr 10 16:15:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e53562c-e3e1-4eb7-b812-a1564b39eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Flow 'volume_create_manager' (f9a36f40-da91-4fc7-9aee-5556b6d2211d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:43 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-de4c4dcd-357c-4c2d-8899-617a4d105ae2 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Created volume successfully. Apr 10 16:15:43 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b 1073741824" returned: 0 in 0.678s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:43 devstack sudo[83752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b Apr 10 16:15:43 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e9370a3a-9130-4d03-9686-0713b6ab3b8d tempest-GroupsTest-1697654237 None] Update group completed successfully. Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:44 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b" returned: 0 in 0.953s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.040s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387a3282-8db0-4631-b7d8-63372997fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1238fbb-3398-4ce4-b806-530f4eb8836b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021784ed-8964-41a3-a29e-3d270b4321b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3720ebb-2405-4120-af86-66fa02e11345]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:44 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Volume volume-e1238fbb-3398-4ce4-b806-530f4eb8836b (e1238fbb-3398-4ce4-b806-530f4eb8836b): created successfully Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021784ed-8964-41a3-a29e-3d270b4321b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Flow 'volume_create_manager' (4bfc9acc-8945-41cf-954a-9b031577118f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-294f7d99-6faf-4c3b-97e4-65ae5781b855 tempest-VolumesTestJSON-1496765882 None] Created volume successfully. Apr 10 16:15:44 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca Apr 10 16:15:44 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:45 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" returned: 0 in 0.557s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.576s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79', 'name': 'volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dec184ab-3bd1-4e7b-b3f4-68d8c337c90c', 'enforce_multipath': True} {{(pid=82117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 16:15:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-99a1a8a4-00ad-436e-a6e7-8fa5ec65aea0 req-306167ee-b39a-4121-a485-f9b0385ebb00 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] attachment_update completed successfully. Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Flow 'volume_create_manager' (b3372acc-9d2f-481a-9734-b3504e7f558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600b9327-2003-4b04-adfd-99dce2e71e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600b9327-2003-4b04-adfd-99dce2e71e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1129934761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f77de0c-710c-46c2-8fd5-877f32887bde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa13bd868c144741bf4c13f32c8b88ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:45Z,use_quota=True,user_id='7b8b1fc6127a4c8287853b4e8abb6fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5da2eb1-5ecb-4d28-a605-2d740961671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5da2eb1-5ecb-4d28-a605-2d740961671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcce8000-b57d-46ae-8e57-69b1a755cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcce8000-b57d-46ae-8e57-69b1a755cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f77de0c-710c-46c2-8fd5-877f32887bde', 'volume_name': 'volume-7f77de0c-710c-46c2-8fd5-877f32887bde', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62da775d-3cba-4497-a9be-9136bb069b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62da775d-3cba-4497-a9be-9136bb069b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680915ef-be1f-4797-a0d0-ab9b655d9cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:45 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Volume 7f77de0c-710c-46c2-8fd5-877f32887bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f77de0c-710c-46c2-8fd5-877f32887bde', 'volume_size': 1} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1129934761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f77de0c-710c-46c2-8fd5-877f32887bde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa13bd868c144741bf4c13f32c8b88ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:45Z,use_quota=True,user_id='7b8b1fc6127a4c8287853b4e8abb6fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Creating volume 7f77de0c-710c-46c2-8fd5-877f32887bde {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:45 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:45 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde 1073741824 Apr 10 16:15:45 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Acquiring lock "cinder-quobyte-dfa233d3-65cb-4515-813d-1e88c4598827" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Lock "cinder-quobyte-dfa233d3-65cb-4515-813d-1e88c4598827" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e32d5-130c-479c-b110-9e2983becc5d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:45 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 Apr 10 16:15:45 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:46 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde 1073741824" returned: 0 in 0.892s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:46 devstack sudo[83806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde Apr 10 16:15:46 devstack sudo[83806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:46 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827" returned: 0 in 0.664s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:46 devstack sudo[83808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827 Apr 10 16:15:46 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:46 devstack sudo[83806]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde" returned: 0 in 0.637s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680915ef-be1f-4797-a0d0-ab9b655d9cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f77de0c-710c-46c2-8fd5-877f32887bde', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72d0b37-0484-4e22-bce8-c3ded9ef09f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:46 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Volume volume-7f77de0c-710c-46c2-8fd5-877f32887bde (7f77de0c-710c-46c2-8fd5-877f32887bde): created successfully Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72d0b37-0484-4e22-bce8-c3ded9ef09f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Flow 'volume_create_manager' (b3372acc-9d2f-481a-9734-b3504e7f558f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:46 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4e4b4f0c-1fde-4112-803f-31f38066abeb tempest-VolumesTestJSON-1496765882 None] Created volume successfully. Apr 10 16:15:46 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dfa233d3-65cb-4515-813d-1e88c4598827" returned: 0 in 0.611s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Lock "cinder-quobyte-dfa233d3-65cb-4515-813d-1e88c4598827" released by "delete_volume" :: held 1.330s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Acquiring lock "cinder-quobyte-e25b2605-1dd9-4a46-b6a2-71dc81985ec3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Lock "cinder-quobyte-e25b2605-1dd9-4a46-b6a2-71dc81985ec3" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8535c5e-7c10-495d-bb74-4d0539f57e97]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:47 devstack sudo[83819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 Apr 10 16:15:47 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:47 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3" returned: 0 in 0.695s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:47 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3 Apr 10 16:15:47 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Flow 'volume_create_manager' (73f5b4f2-e8af-4743-be20-6c9f0489efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb96554-9193-4251-af73-8ffb9879d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb96554-9193-4251-af73-8ffb9879d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2088984763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15770e0a-b953-4980-b10a-31261e0f0b1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa13bd868c144741bf4c13f32c8b88ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:48Z,use_quota=True,user_id='7b8b1fc6127a4c8287853b4e8abb6fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59a12ee-c0d4-4819-a3b9-796d14c24fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59a12ee-c0d4-4819-a3b9-796d14c24fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f5165f-414e-4ae0-845f-648dc3839508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f5165f-414e-4ae0-845f-648dc3839508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15770e0a-b953-4980-b10a-31261e0f0b1d', 'volume_name': 'volume-15770e0a-b953-4980-b10a-31261e0f0b1d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d76b42a-9134-4958-b195-e9aa6a36387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d76b42a-9134-4958-b195-e9aa6a36387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7c45f6-ae8c-4c2f-9643-46802ac98b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:47 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Volume 15770e0a-b953-4980-b10a-31261e0f0b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15770e0a-b953-4980-b10a-31261e0f0b1d', 'volume_size': 1} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2088984763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15770e0a-b953-4980-b10a-31261e0f0b1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa13bd868c144741bf4c13f32c8b88ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:48Z,use_quota=True,user_id='7b8b1fc6127a4c8287853b4e8abb6fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Creating volume 15770e0a-b953-4980-b10a-31261e0f0b1d {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:47 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:47 devstack sudo[83895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d 1073741824 Apr 10 16:15:47 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:48 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e25b2605-1dd9-4a46-b6a2-71dc81985ec3" returned: 0 in 0.515s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Lock "cinder-quobyte-e25b2605-1dd9-4a46-b6a2-71dc81985ec3" released by "delete_volume" :: held 1.233s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Created reservations ['f5c8d213-35c2-42a7-8b3a-51193fa2b3a5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:48 devstack cinder-volume[82117]: WARNING cinder.quota [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-857863712 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-857863712, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:15:48 devstack cinder-volume[82117]: WARNING cinder.quota [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-857863712 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-857863712, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Created reservations ['03695bdd-9dc9-48df-8883-32335b7a79d7', '2474ad08-e3d8-413d-b7da-474a32c52939', '30fe43dc-cc55-48e2-92d6-5a498c655636', 'b4aea02a-23cb-49b4-9d11-d9b96936591f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:48 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d 1073741824" returned: 0 in 0.573s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Created reservations ['1aa1416a-d3be-45cb-bdd9-9688d3780499', '4027449e-4619-4ae0-9f2b-8fb4242fb8e2', 'fb85efde-d9c4-49c1-b40a-d70ba7577b23', 'ad512c07-8d41-4b7f-8450-f6101c6bdf5c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:48 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d Apr 10 16:15:48 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:48 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:48 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:48 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d" returned: 0 in 0.483s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7c45f6-ae8c-4c2f-9643-46802ac98b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15770e0a-b953-4980-b10a-31261e0f0b1d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00d0c96-b89f-4599-aeaa-67dd063dbc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:48 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Volume volume-15770e0a-b953-4980-b10a-31261e0f0b1d (15770e0a-b953-4980-b10a-31261e0f0b1d): created successfully Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00d0c96-b89f-4599-aeaa-67dd063dbc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Flow 'volume_create_manager' (73f5b4f2-e8af-4743-be20-6c9f0489efe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:48 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-76c99369-14ef-44d5-bb44-97855097d447 tempest-VolumesTestJSON-1496765882 None] Created volume successfully. Apr 10 16:15:49 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:49 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1e9e8e2a-b46f-4dd5-acd1-c345757b4d73 tempest-GroupsTest-1697654237 None] Delete group completed successfully. Apr 10 16:15:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Acquiring lock "cinder-15770e0a-b953-4980-b10a-31261e0f0b1d-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Lock "cinder-15770e0a-b953-4980-b10a-31261e0f0b1d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Acquiring lock "cinder-quobyte-15770e0a-b953-4980-b10a-31261e0f0b1d" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Lock "cinder-quobyte-15770e0a-b953-4980-b10a-31261e0f0b1d" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e81ec28-e88b-4d13-821b-f1ce628cba1f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:52 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d Apr 10 16:15:52 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:53 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d" returned: 0 in 1.199s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:53 devstack sudo[84273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d Apr 10 16:15:53 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:53 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-15770e0a-b953-4980-b10a-31261e0f0b1d" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Lock "cinder-quobyte-15770e0a-b953-4980-b10a-31261e0f0b1d" released by "delete_volume" :: held 1.862s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Created reservations ['509e0d71-7de9-4b37-a308-560c550ac706', 'dd505ccf-43ad-44fd-8cd1-cc40cb6d9d41', 'd9ac2ce3-d855-4dc9-ba38-6489e39909ce', '899d9cc0-9d89-4b02-a50f-2202ac21c174'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:53 devstack sudo[84278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:53 devstack sudo[84278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "cinder-7f77de0c-710c-46c2-8fd5-877f32887bde-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Lock "cinder-7f77de0c-710c-46c2-8fd5-877f32887bde-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "cinder-quobyte-7f77de0c-710c-46c2-8fd5-877f32887bde" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Lock "cinder-quobyte-7f77de0c-710c-46c2-8fd5-877f32887bde" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee797700-d904-40ab-b441-b1ae0e3ec863]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-74d00cf1-75f6-4eca-a77d-0b84566cced5 tempest-GroupsV314Test-419886974 None] Group tempest-GroupsV314Test-Group-749529390: creating Apr 10 16:15:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-74d00cf1-75f6-4eca-a77d-0b84566cced5 tempest-GroupsV314Test-419886974 None] Group tempest-GroupsV314Test-Group-749529390: created successfully Apr 10 16:15:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-74d00cf1-75f6-4eca-a77d-0b84566cced5 tempest-GroupsV314Test-419886974 None] Create group completed successfully. Apr 10 16:15:54 devstack sudo[84281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde Apr 10 16:15:54 devstack sudo[84281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:54 devstack sudo[84278]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.074s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Deleted volume successfully. Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=101,cinder:UPDATE=117,cinder:INSERT=18,cinder:DELETE=4 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:15:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e9ee5e20-5d85-4c2e-af88-d6345eb2b83e tempest-VolumesTestJSON-1496765882 None] Lock "cinder-15770e0a-b953-4980-b10a-31261e0f0b1d-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:55 devstack sudo[84281]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde" returned: 0 in 0.871s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:55 devstack sudo[84305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde Apr 10 16:15:55 devstack sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=82,cinder:UPDATE=90,cinder:INSERT=23,cinder:DELETE=10 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Flow 'volume_create_manager' (152b13e5-31e6-4640-9d5b-e92742a50689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69655c0a-e525-4d9e-a901-2ad7df5ab1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69655c0a-e525-4d9e-a901-2ad7df5ab1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538787508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b62b314-0192-4910-a714-8479e24988ca,host='devstack@QuobyteHD#QuobyteHD',id=166f0b8b-9c5e-4bb5-adb2-987fd50c5878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3c716f5180464293e99b008e42d242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:56Z,use_quota=True,user_id='0bcbea249d5747a3ba23d1f2059c3a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fd14ee6-f508-4197-a8d8-98615a96361e),volume_type_id=6fd14ee6-f508-4197-a8d8-98615a96361e)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3026a3d9-3c7d-4f91-bfae-787d00f7e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3026a3d9-3c7d-4f91-bfae-787d00f7e337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:55 devstack sudo[84305]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa311cd9-e4b4-4054-9a8d-4a032916178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa311cd9-e4b4-4054-9a8d-4a032916178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166f0b8b-9c5e-4bb5-adb2-987fd50c5878', 'volume_name': 'volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6494de00-ba0a-4c2b-911a-cf2c945795e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6494de00-ba0a-4c2b-911a-cf2c945795e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38394562-1c7b-401c-9fda-cc51fdcd5adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:55 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Volume 166f0b8b-9c5e-4bb5-adb2-987fd50c5878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878', 'volume_size': 1} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b62b314-0192-4910-a714-8479e24988ca,created_at=2026-04-10T14:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538787508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b62b314-0192-4910-a714-8479e24988ca,host='devstack@QuobyteHD#QuobyteHD',id=166f0b8b-9c5e-4bb5-adb2-987fd50c5878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3c716f5180464293e99b008e42d242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:15:56Z,use_quota=True,user_id='0bcbea249d5747a3ba23d1f2059c3a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fd14ee6-f508-4197-a8d8-98615a96361e),volume_type_id=6fd14ee6-f508-4197-a8d8-98615a96361e)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Creating volume 166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:15:55 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7f77de0c-710c-46c2-8fd5-877f32887bde" returned: 0 in 0.542s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:55 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 1073741824 Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Lock "cinder-quobyte-7f77de0c-710c-46c2-8fd5-877f32887bde" released by "delete_volume" :: held 1.452s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:55 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Created reservations ['98de899f-703f-4820-8a03-2d0c41119f6c', '9a738dd7-b9ad-467b-87e5-d72872897783', 'fe3213bc-6d82-44cd-8436-b187ad8b27fc', '791c356c-cd9b-4ff3-91d2-3418ff1d51a0'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:55 devstack sudo[84313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:55 devstack sudo[84313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:56 devstack sudo[84313]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.486s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:56 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Deleted volume successfully. Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 1073741824" returned: 0 in 0.596s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1d2c83b-ad82-4d48-a9c8-0af2d32fc895 tempest-VolumesTestJSON-1496765882 None] Lock "cinder-7f77de0c-710c-46c2-8fd5-877f32887bde-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Acquiring lock "cinder-e1238fbb-3398-4ce4-b806-530f4eb8836b-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Lock "cinder-e1238fbb-3398-4ce4-b806-530f4eb8836b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:56 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:15:56 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Acquiring lock "cinder-quobyte-e1238fbb-3398-4ce4-b806-530f4eb8836b" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Lock "cinder-quobyte-e1238fbb-3398-4ce4-b806-530f4eb8836b" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[754cd14b-8c65-4c01-b0cd-e5687072fc85]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:56 devstack sudo[84321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b Apr 10 16:15:56 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:56 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 0.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38394562-1c7b-401c-9fda-cc51fdcd5adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09659ee2-8eef-4cbd-9125-0dd7de28f0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:15:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Volume volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 (166f0b8b-9c5e-4bb5-adb2-987fd50c5878): created successfully Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09659ee2-8eef-4cbd-9125-0dd7de28f0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:15:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Flow 'volume_create_manager' (152b13e5-31e6-4640-9d5b-e92742a50689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:15:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6ef2ae0b-58f0-4555-9f24-18f0faa8fd7d tempest-GroupsV314Test-419886974 None] Created volume successfully. Apr 10 16:15:57 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b" returned: 0 in 0.553s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:57 devstack sudo[84328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b Apr 10 16:15:57 devstack sudo[84328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:57 devstack sudo[84328]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e1238fbb-3398-4ce4-b806-530f4eb8836b" returned: 0 in 0.545s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Lock "cinder-quobyte-e1238fbb-3398-4ce4-b806-530f4eb8836b" released by "delete_volume" :: held 1.127s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Created reservations ['95148a8e-2a38-460c-9793-e7f6d03a8822', '682b8788-86d3-4297-a8c0-8cb3e1a1d877', 'e57e4a9c-676e-4401-89ad-f3df670b5abe', '73924750-4cb6-4ae2-bbe8-550015856f13'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:15:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:57 devstack sudo[84360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:15:57 devstack sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:15:58 devstack sudo[84360]: pam_unix(sudo:session): session closed for user root Apr 10 16:15:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.615s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:15:58 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:15:58 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Deleted volume successfully. Apr 10 16:15:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d8cbd74f-a16d-4cd5-aa50-949b0a28610b tempest-VolumesTestJSON-1496765882 None] Lock "cinder-e1238fbb-3398-4ce4-b806-530f4eb8836b-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:15:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:15:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.010s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:15:59 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Cloning volume 166f0b8b-9c5e-4bb5-adb2-987fd50c5878 to volume fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 Apr 10 16:15:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Creating offline snapshot 7514149d-fa51-483a-a1e5-6de6586ff827 of volume 166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:15:59 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbaae31-9516-4b95-b710-b8775a1b8145]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:15:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:15:59 devstack sudo[84426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:15:59 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:00 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 1.251s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:00 devstack sudo[84437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 1G Apr 10 16:16:00 devstack sudo[84437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:01 devstack sudo[84437]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 1G" returned: 0 in 0.958s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:01 devstack sudo[84460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 Apr 10 16:16:01 devstack sudo[84460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:02 devstack sudo[84460]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827" returned: 0 in 0.823s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:02 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:16:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:02 devstack sudo[84465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 Apr 10 16:16:02 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a3793282-4a34-4ea1-a9d0-396ab8438897 tempest-GroupSnapshotsV319Test-1386833384 None] Group tempest-GroupSnapshotsV319Test-Group-1595107592: creating Apr 10 16:16:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a3793282-4a34-4ea1-a9d0-396ab8438897 tempest-GroupSnapshotsV319Test-1386833384 None] Group tempest-GroupSnapshotsV319Test-Group-1595107592: created successfully Apr 10 16:16:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a3793282-4a34-4ea1-a9d0-396ab8438897 tempest-GroupSnapshotsV319Test-1386833384 None] Create group completed successfully. Apr 10 16:16:03 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827" returned: 0 in 0.764s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:03 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info Apr 10 16:16:03 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:03 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:03 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:16:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:03 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info Apr 10 16:16:03 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:04 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.info" returned: 0 in 0.684s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Acquiring lock "cinder-quobyte-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] snapshot: 7514149d-fa51-483a-a1e5-6de6586ff827, volume: fe1a0f34-5f94-4beb-98fa-7b34d8a57c66, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1c6ccf-2297-4e30-b613-1bd0bbe234f4]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:04 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 Apr 10 16:16:04 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Flow 'volume_create_manager' (97cd3b45-12dc-480f-8b2b-83edfc62b575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf1a400-5136-4a7d-a4ff-4a0a15a4bbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf1a400-5136-4a7d-a4ff-4a0a15a4bbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468371772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6a2fffe-d028-4657-852e-711dd4b1e57b,host='devstack@QuobyteHD#QuobyteHD',id=44e0ccdf-0990-4c68-9423-e30eb2217613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57a091338840d580b415451401f15b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:05Z,use_quota=True,user_id='57f65e6aa5464ac0a213a16d8c3d8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f226ef8-6212-4697-97cf-d2755bcbdbbc),volume_type_id=4f226ef8-6212-4697-97cf-d2755bcbdbbc)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee2d49c-fe3f-452b-96b5-8ed79eaa6a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee2d49c-fe3f-452b-96b5-8ed79eaa6a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fde58d-6f22-45bb-8709-8ba03124dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fde58d-6f22-45bb-8709-8ba03124dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e0ccdf-0990-4c68-9423-e30eb2217613', 'volume_name': 'volume-44e0ccdf-0990-4c68-9423-e30eb2217613', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147b7bac-c70e-43f0-9230-818055969c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147b7bac-c70e-43f0-9230-818055969c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f078fa80-f1e2-4fa2-9321-4c6293e9aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Volume 44e0ccdf-0990-4c68-9423-e30eb2217613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e0ccdf-0990-4c68-9423-e30eb2217613', 'volume_size': 1} Apr 10 16:16:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:05 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827" returned: 0 in 0.776s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb78ed-856e-4f06-88cd-97b096d2374f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:05 devstack sudo[84482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:16:05 devstack sudo[84482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:05 devstack sudo[84482]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 0.723s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:16:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:05 devstack sudo[84505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 Apr 10 16:16:05 devstack sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:10 devstack sudo[84505]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" returned: 0 in 5.084s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:11 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1583946-a54b-4ad1-b529-5a39106e7fed]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:11 devstack sudo[84661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:16:11 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:11 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 0.869s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:11 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:16:11 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Converted 1024.00 MB image at 201.34 MB/s Apr 10 16:16:11 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:16:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:11 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 Apr 10 16:16:11 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:12 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" returned: 0 in 0.472s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" released by "_copy_volume_from_snapshot" :: held 7.990s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Acquiring lock "cinder-quobyte-7514149d-fa51-483a-a1e5-6de6586ff827" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-7514149d-fa51-483a-a1e5-6de6586ff827" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Deleting offline snapshot 7514149d-fa51-483a-a1e5-6de6586ff827 of volume 166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] snapshot_file for this snap is: volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[de984df7-6514-4111-9769-8e653abea61a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:12 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 Apr 10 16:16:12 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:13 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827" returned: 0 in 0.666s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:16:13 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b5498-0a3f-4c80-9f87-3448681c4649]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:13 devstack sudo[84708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:16:13 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:13 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 0.752s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:13 devstack sudo[84764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 Apr 10 16:16:13 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:14 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827" returned: 0 in 0.807s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:14 devstack sudo[84773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827 Apr 10 16:16:14 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:16:15 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:16:15 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:15 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878.7514149d-fa51-483a-a1e5-6de6586ff827" returned: 0 in 0.907s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-7514149d-fa51-483a-a1e5-6de6586ff827" released by "_delete_snapshot" :: held 3.244s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.486s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.018s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6a2fffe-d028-4657-852e-711dd4b1e57b,created_at=2026-04-10T14:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468371772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6a2fffe-d028-4657-852e-711dd4b1e57b,host='devstack@QuobyteHD#QuobyteHD',id=44e0ccdf-0990-4c68-9423-e30eb2217613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57a091338840d580b415451401f15b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:05Z,use_quota=True,user_id='57f65e6aa5464ac0a213a16d8c3d8c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f226ef8-6212-4697-97cf-d2755bcbdbbc),volume_type_id=4f226ef8-6212-4697-97cf-d2755bcbdbbc)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Creating volume 44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:16:15 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:16:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:15 devstack sudo[84780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 1073741824 Apr 10 16:16:15 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e1d795dc-a525-4d65-86f7-16e143a225e2 tempest-GroupsV314Test-419886974 None] Create group from source-group-6b62b314-0192-4910-a714-8479e24988ca completed successfully. Apr 10 16:16:16 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.898s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Flow 'volume_create_manager' (e73bed38-6ed3-40e9-86a3-45fbfc7f1ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58a69d9-e680-44b1-8fe3-0edd924356b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58a69d9-e680-44b1-8fe3-0edd924356b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-370883624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a36646c-70ae-4aa4-a3ce-f9500c28f8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f171e2790d6c45fb9bd7492592678d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:16Z,use_quota=True,user_id='cf8c985a58324684b7405cd4a46e256e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c6a6da-379e-4325-8e47-e870d2bca050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c6a6da-379e-4325-8e47-e870d2bca050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04a8a83-be73-429a-aa25-ada52986fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04a8a83-be73-429a-aa25-ada52986fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a36646c-70ae-4aa4-a3ce-f9500c28f8e5', 'volume_name': 'volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e93fe1d-7374-443f-b2fb-5add860a3379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e93fe1d-7374-443f-b2fb-5add860a3379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571e588-10c8-4c5d-8f04-b49cad0c3785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:16 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Volume 8a36646c-70ae-4aa4-a3ce-f9500c28f8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5', 'volume_size': 1} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Acquiring lock "cinder-quobyte-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca499af7-d8dc-4ee5-8e23-e49829ae60f5]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:16 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 Apr 10 16:16:16 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:16 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 1073741824" returned: 0 in 1.317s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:17 devstack sudo[84792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 Apr 10 16:16:17 devstack sudo[84792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:17 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" returned: 0 in 0.651s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:17 devstack sudo[84799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66 Apr 10 16:16:17 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:17 devstack sudo[84792]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613" returned: 0 in 0.578s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-370883624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a36646c-70ae-4aa4-a3ce-f9500c28f8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f171e2790d6c45fb9bd7492592678d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:16Z,use_quota=True,user_id='cf8c985a58324684b7405cd4a46e256e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Creating volume 8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:16:17 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f078fa80-f1e2-4fa2-9321-4c6293e9aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e0ccdf-0990-4c68-9423-e30eb2217613', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0bf2a5-a66a-44a9-93f1-f73cb69ac10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:17 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 1073741824 Apr 10 16:16:17 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Volume volume-44e0ccdf-0990-4c68-9423-e30eb2217613 (44e0ccdf-0990-4c68-9423-e30eb2217613): created successfully Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0bf2a5-a66a-44a9-93f1-f73cb69ac10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Flow 'volume_create_manager' (97cd3b45-12dc-480f-8b2b-83edfc62b575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:17 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c401b1b9-37b7-4e6e-9748-7e692654b61e tempest-GroupSnapshotsV319Test-1386833384 None] Created volume successfully. Apr 10 16:16:18 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" returned: 0 in 0.640s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-fe1a0f34-5f94-4beb-98fa-7b34d8a57c66" released by "delete_volume" :: held 1.333s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Created reservations ['d2613c1d-27ef-4f9e-9bc4-b3068525c7f5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:18 devstack cinder-volume[82117]: WARNING cinder.quota [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1856527172 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1856527172, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:16:18 devstack cinder-volume[82117]: WARNING cinder.quota [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1856527172 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1856527172, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Created reservations ['58aedc44-f334-40d4-8115-71a5fffa1d32', 'd08fb9b6-8aff-4643-96c1-3f66efeea536', 'c7d87b6f-52db-46ca-8a29-ac549183c93d', 'ff8aff8f-a159-4e70-be04-00be6b9989d3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:18 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:16:18 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:18 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 1073741824" returned: 0 in 0.745s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:18 devstack sudo[84811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 Apr 10 16:16:18 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:18 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.509s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:18 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:16:18 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-19d6cb79-a6c5-4dd5-b1cd-e15fbeb12427 tempest-GroupsV314Test-419886974 None] Delete group completed successfully. Apr 10 16:16:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] GroupSnapshot 2071b8b5-b40f-4470-9d2a-1a1b16a09b05: creating. Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Group snapshot 2071b8b5-b40f-4470-9d2a-1a1b16a09b05: creating. {{(pid=82117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:19 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5" returned: 0 in 0.716s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.047s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Creating offline snapshot b3e94fea-46a8-4670-8637-0080d04d2efc of volume 44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571e588-10c8-4c5d-8f04-b49cad0c3785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed30261-a695-4b4a-a0b0-dc0748be51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[11585fdc-d705-436e-ba48-7268f4a01b73]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Acquiring lock "cinder-quobyte-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:19 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Volume volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 (8a36646c-70ae-4aa4-a3ce-f9500c28f8e5): created successfully Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed30261-a695-4b4a-a0b0-dc0748be51e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Flow 'volume_create_manager' (e73bed38-6ed3-40e9-86a3-45fbfc7f1ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e68e14cb-f250-48ac-8d98-284d80ce8e1a tempest-ServerRescueNegativeTestJSON-539453139 None] Created volume successfully. Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" acquired by "delete_volume" :: waited 0.032s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:19 devstack sudo[84815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 Apr 10 16:16:19 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c16436-7426-4393-b69c-897a8a52d1c5]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:19 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:16:19 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:19 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613" returned: 0 in 0.709s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:19 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc 1G Apr 10 16:16:19 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:19 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 0.665s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:19 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878 Apr 10 16:16:20 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:20 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc 1G" returned: 0 in 0.571s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e0ccdf-0990-4c68-9423-e30eb2217613 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:20 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e0ccdf-0990-4c68-9423-e30eb2217613 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc Apr 10 16:16:20 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:20 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" returned: 0 in 0.598s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Lock "cinder-quobyte-166f0b8b-9c5e-4bb5-adb2-987fd50c5878" released by "delete_volume" :: held 1.346s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Created reservations ['c908c211-3792-4103-b7b4-566cafb48f3f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Created reservations ['de217331-5c3e-44fc-a003-e6adf96d7702', '4d4e088d-93de-4c03-990a-56f29f7be180', '425f0cab-b931-481b-9996-199d2d2c396d', 'c834cb3b-299d-4a44-934b-3fde32eeb039'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:20 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:16:20 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:21 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e0ccdf-0990-4c68-9423-e30eb2217613 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc" returned: 0 in 0.704s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:21 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:16:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:21 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc Apr 10 16:16:21 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:21 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.906s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:21 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:16:21 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-989b98b6-4607-4f6f-b539-de8edece8007 tempest-GroupsV314Test-419886974 None] Delete group completed successfully. Apr 10 16:16:22 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc" returned: 0 in 1.133s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:22 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info Apr 10 16:16:22 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:23 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info" returned: 0 in 1.021s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:23 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:16:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:23 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info Apr 10 16:16:23 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:24 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.info" returned: 0 in 1.011s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.269s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1994c08b-f574-44e1-8db2-143692e0571a tempest-GroupSnapshotsV319Test-1386833384 None] group_snapshot 2071b8b5-b40f-4470-9d2a-1a1b16a09b05: created successfully Apr 10 16:16:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] group_snapshot 2071b8b5-b40f-4470-9d2a-1a1b16a09b05: deleting Apr 10 16:16:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] group_snapshot 2071b8b5-b40f-4470-9d2a-1a1b16a09b05: deleting {{(pid=82117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 16:16:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "cinder-quobyte-44e0ccdf-0990-4c68-9423-e30eb2217613" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Lock "cinder-quobyte-44e0ccdf-0990-4c68-9423-e30eb2217613" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "cinder-quobyte-b3e94fea-46a8-4670-8637-0080d04d2efc" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Lock "cinder-quobyte-b3e94fea-46a8-4670-8637-0080d04d2efc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Deleting offline snapshot b3e94fea-46a8-4670-8637-0080d04d2efc of volume 44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] snapshot_file for this snap is: volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96a8f4-352f-44d2-9b4d-4f9936e90fc3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:26 devstack sudo[84906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc Apr 10 16:16:26 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:26 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc" returned: 0 in 0.595s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e0ccdf-0990-4c68-9423-e30eb2217613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5210b919-38c3-4ea7-a6f4-32d6e79076de]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:26 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 Apr 10 16:16:26 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:27 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613" returned: 0 in 0.662s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:27 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc Apr 10 16:16:27 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:27 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc" returned: 0 in 0.595s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:27 devstack sudo[84930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc Apr 10 16:16:27 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:28 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613.b3e94fea-46a8-4670-8637-0080d04d2efc" returned: 0 in 0.553s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Lock "cinder-quobyte-b3e94fea-46a8-4670-8637-0080d04d2efc" released by "_delete_snapshot" :: held 2.513s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Lock "cinder-quobyte-44e0ccdf-0990-4c68-9423-e30eb2217613" released by "delete_snapshot" :: held 2.534s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:28 devstack cinder-volume[82117]: WARNING cinder.quota [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-981631682 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-981631682, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:16:28 devstack cinder-volume[82117]: WARNING cinder.quota [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-981631682 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-981631682, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:16:28 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] Created reservations ['00a1c6ab-6137-4167-8337-349510b294cc', '6813c9a6-a96a-4cfa-8178-28bced846ead', 'a5a56f5b-62a9-46cd-9324-d04ee6385235', '44dbc9e5-cde2-4331-8554-4ce133d37545'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:28 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7e3a0f88-946e-4e88-ba61-9c7d0f7822bd tempest-GroupSnapshotsV319Test-1386833384 None] group_snapshot 2071b8b5-b40f-4470-9d2a-1a1b16a09b05: deleted successfully Apr 10 16:16:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "cinder-quobyte-44e0ccdf-0990-4c68-9423-e30eb2217613" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Lock "cinder-quobyte-44e0ccdf-0990-4c68-9423-e30eb2217613" acquired by "delete_volume" :: waited 0.085s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08771b7-40d3-4262-b09f-75b11e9ffff1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:30 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 Apr 10 16:16:30 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:31 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613" returned: 0 in 0.958s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:31 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613 Apr 10 16:16:31 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:32 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-44e0ccdf-0990-4c68-9423-e30eb2217613" returned: 0 in 0.927s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Lock "cinder-quobyte-44e0ccdf-0990-4c68-9423-e30eb2217613" released by "delete_volume" :: held 2.098s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Created reservations ['c766da32-67f8-4bc1-a9d7-1b5ae0fae5de'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:32 devstack cinder-volume[82117]: WARNING cinder.quota [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-981631682 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-981631682, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Created reservations ['ed1b3d92-ede1-44d1-a4de-b4df55e2e7d8', 'b418b1b2-eddb-490f-8fdb-4a91ea811604', '3637011f-77e2-4cb4-8502-f60db548f899', '15331434-8886-40ab-b355-67bf6d78b66a'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:32 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:16:32 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:33 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.935s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:33 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:16:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-97708ed1-153c-45c1-b03b-09c72a989b70 tempest-GroupSnapshotsV319Test-1386833384 None] Delete group completed successfully. Apr 10 16:16:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Acquiring lock "cinder-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "cinder-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Acquiring lock "cinder-quobyte-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:16:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "cinder-quobyte-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5" acquired by "delete_volume" :: waited 0.029s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:16:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51d0ed-a521-4b8c-ac98-36f41cc205c9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:38 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 Apr 10 16:16:38 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:39 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5" returned: 0 in 1.147s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:39 devstack sudo[85101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5 Apr 10 16:16:39 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:40 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5" returned: 0 in 0.720s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "cinder-quobyte-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5" released by "delete_volume" :: held 1.989s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Created reservations ['22599cc1-b716-4c41-8af5-5b886eb051a7', '63145e8d-a1e5-4d95-be4d-f1df28e68fa7', '7053ada2-c231-4847-b071-b3d009ebc746', 'a9cff1de-62c0-41d8-867a-0dac3da896ad'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:40 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:16:40 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:41 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.078s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:41 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:16:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Deleted volume successfully. Apr 10 16:16:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a055f8ce-a97e-4251-9818-9694bb052447 tempest-ServerRescueNegativeTestJSON-539453139 None] Lock "cinder-8a36646c-70ae-4aa4-a3ce-f9500c28f8e5-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:16:50 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=69,cinder:SELECT=51,cinder:DELETE=1,cinder:INSERT=14 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:16:51 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=67,cinder:INSERT=16,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Flow 'volume_create_manager' (e0c85324-aa9c-488a-9611-24387b4391e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1886a58a-466e-45b1-a0f1-d9413cf61ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1886a58a-466e-45b1-a0f1-d9413cf61ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:55Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179add58-3dcc-4906-919d-104b54107992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fbe225aaf484fb9bd28878fe70e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:56Z,use_quota=True,user_id='6fd91ab345ec470eacce67c6c20e633a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14df732-2a09-42b0-97a8-5b349352c769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14df732-2a09-42b0-97a8-5b349352c769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141e4b55-fe72-48c9-af4c-cda4aee9e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:55 devstack cinder-volume[82117]: DEBUG cinder.image.glance [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Creating Keystone auth plugin from conf {{(pid=82117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Flow 'volume_create_manager' (6f670e8d-a236-42ae-b375-6fc5817f06e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132455f8-529c-4e99-b6af-df24cc1c15ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132455f8-529c-4e99-b6af-df24cc1c15ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-210039052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd0d405-2631-4495-bc0b-a7927d3a46f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce78431ea6c4489291d6653f8034656e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:56Z,use_quota=True,user_id='cf9733cbfae7487f9f7fc9c8e7d0828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ef38ff-4030-4722-b6f9-96369c2e0eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ef38ff-4030-4722-b6f9-96369c2e0eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6054b6a5-2553-4789-b8fc-3767e2aa7eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6054b6a5-2553-4789-b8fc-3767e2aa7eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd0d405-2631-4495-bc0b-a7927d3a46f5', 'volume_name': 'volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd881b31-46b2-42fc-bd46-21620cd889f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd881b31-46b2-42fc-bd46-21620cd889f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f30120a-eabd-4338-8a3b-63ccfa060bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Volume 2cd0d405-2631-4495-bc0b-a7927d3a46f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5', 'volume_size': 1} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-210039052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd0d405-2631-4495-bc0b-a7927d3a46f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce78431ea6c4489291d6653f8034656e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:56Z,use_quota=True,user_id='cf9733cbfae7487f9f7fc9c8e7d0828d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Creating volume 2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:16:56 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:56 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 1073741824 Apr 10 16:16:56 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141e4b55-fe72-48c9-af4c-cda4aee9e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '179add58-3dcc-4906-919d-104b54107992', 'volume_name': 'volume-179add58-3dcc-4906-919d-104b54107992', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06dd83a-162e-4b85-8bb2-aff0cdcd5087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06dd83a-162e-4b85-8bb2-aff0cdcd5087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f30b02-07fd-4377-a61f-e9a2f94b902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Volume 179add58-3dcc-4906-919d-104b54107992: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-179add58-3dcc-4906-919d-104b54107992', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Trying to clone 179add58-3dcc-4906-919d-104b54107992 from image 64fc5a94-65e7-4041-898d-7b63047838a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]). {{(pid=82117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 16:16:56 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 16:16:56 devstack cinder-volume[82117]: INFO cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Image download 20.69 MB at 20.69 MB/s Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a5bdd9-cdc8-4b89-ba77-284cb2588022]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:57 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD Apr 10 16:16:57 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:57 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 1073741824" returned: 0 in 1.174s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:57 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 Apr 10 16:16:57 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:57 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 is fetched for user 6fd91ab345ec470eacce67c6c20e633a. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a882c6a-a06e-457f-b32d-589ace382e41]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:57 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD Apr 10 16:16:57 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:57 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5" returned: 0 in 0.471s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f30120a-eabd-4338-8a3b-63ccfa060bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279989bb-0475-406c-859e-74c5ca4d7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:16:57 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Volume volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 (2cd0d405-2631-4495-bc0b-a7927d3a46f5): created successfully Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279989bb-0475-406c-859e-74c5ca4d7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:16:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Flow 'volume_create_manager' (6f670e8d-a236-42ae-b375-6fc5817f06e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:16:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b37bc31d-b9a6-4c85-9bb3-39fc4da91074 tempest-SnapshotMetadataTestJSON-1500848821 None] Created volume successfully. Apr 10 16:16:58 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:16:55Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179add58-3dcc-4906-919d-104b54107992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fbe225aaf484fb9bd28878fe70e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:16:56Z,use_quota=True,user_id='6fd91ab345ec470eacce67c6c20e633a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Creating volume 179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:16:58 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:58 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 1073741824 Apr 10 16:16:58 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:16:59 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 1073741824" returned: 0 in 0.845s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:59 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:16:59 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:59 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 0 in 0.519s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Attempting download of 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume 179add58-3dcc-4906-919d-104b54107992. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Creating offline snapshot 16b32097-a46a-4e8c-86c1-0b5e4c348e64 of volume 2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f757a0-1011-4319-8cb4-3c5f0557ebc2]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9934e09b-d04a-4400-857b-b218f6e04a2f]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:16:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:16:59 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp Apr 10 16:16:59 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:16:59 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 Apr 10 16:16:59 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:00 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5" returned: 0 in 0.699s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:00 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp" returned: 0 in 0.669s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:00 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 1G Apr 10 16:17:00 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:00 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp Apr 10 16:17:00 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:01 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 1G" returned: 0 in 0.685s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:01 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 Apr 10 16:17:01 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:01 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp" returned: 1 in 0.739s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_522ifxcp' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a07821-e9b1-486c-aebd-6ffd0c3a749a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:01 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD Apr 10 16:17:01 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:01 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64" returned: 0 in 0.528s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:01 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 is being set with open permissions: ugo+rw Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:01 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 Apr 10 16:17:01 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:01 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:01 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] 64fc5a94-65e7-4041-898d-7b63047838a6 was qcow2, converting to raw {{(pid=82117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 16:17:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:02 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:02 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:02 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64" returned: 0 in 0.655s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:02 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info Apr 10 16:17:02 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:03 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info" returned: 0 in 0.627s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:03 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info is being set with open permissions: ugo+rw Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:03 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info Apr 10 16:17:03 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:03 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 0 in 1.615s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_m0cnqewcdevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:17:03 devstack cinder-volume[82117]: INFO cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Converted 112.00 MB image at 69.29 MB/s Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:03 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 1G Apr 10 16:17:03 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:03 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.info" returned: 0 in 0.596s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.984s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-da3617de-4fcd-4744-9518-720421605754 tempest-SnapshotMetadataTestJSON-1500848821 None] Create snapshot completed successfully Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Flow 'volume_create_manager' (30646fde-3eb5-4022-9437-8be0062ced59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566d1776-aa66-45fc-a861-ad695b7447d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566d1776-aa66-45fc-a861-ad695b7447d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2080984033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9fdc5d-7987-4677-81a5-82be0140ea23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd7670780e443c69aa205fb60ccaddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:04Z,use_quota=True,user_id='b06aaa77e4674a3d803b81c7952c5190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ac6317-44d1-4149-af9b-3c540664283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ac6317-44d1-4149-af9b-3c540664283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f669ff-326d-4e09-87d7-84fc5bf6d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f669ff-326d-4e09-87d7-84fc5bf6d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9fdc5d-7987-4677-81a5-82be0140ea23', 'volume_name': 'volume-5f9fdc5d-7987-4677-81a5-82be0140ea23', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c68d606-292d-4049-a253-df1eb23136ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c68d606-292d-4049-a253-df1eb23136ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5066aadb-3942-4eb9-9d41-ecb36836f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Volume 5f9fdc5d-7987-4677-81a5-82be0140ea23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9fdc5d-7987-4677-81a5-82be0140ea23', 'volume_size': 1} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2080984033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9fdc5d-7987-4677-81a5-82be0140ea23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd7670780e443c69aa205fb60ccaddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:04Z,use_quota=True,user_id='b06aaa77e4674a3d803b81c7952c5190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Creating volume 5f9fdc5d-7987-4677-81a5-82be0140ea23 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:04 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:04 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 1073741824 Apr 10 16:17:04 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "cinder-16b32097-a46a-4e8c-86c1-0b5e4c348e64-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-16b32097-a46a-4e8c-86c1-0b5e4c348e64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "cinder-quobyte-2cd0d405-2631-4495-bc0b-a7927d3a46f5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:04 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 1G" returned: 0 in 1.083s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-quobyte-2cd0d405-2631-4495-bc0b-a7927d3a46f5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "cinder-quobyte-16b32097-a46a-4e8c-86c1-0b5e4c348e64" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-quobyte-16b32097-a46a-4e8c-86c1-0b5e4c348e64" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Deleting offline snapshot 16b32097-a46a-4e8c-86c1-0b5e4c348e64 of volume 2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] snapshot_file for this snap is: volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6d7e3-d5f2-49f7-96a9-24c2c0835748]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd2e06-cef0-4252-9a80-36bdd572c600]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:04 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:04 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:04 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 Apr 10 16:17:04 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:04 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 1073741824" returned: 0 in 0.777s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:04 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 Apr 10 16:17:04 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:05 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 0 in 0.762s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:05 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64" returned: 0 in 0.811s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2434ed7-2575-4ce1-9a60-c27cd38e416d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:05 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:05 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:05 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23" returned: 0 in 0.835s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:05 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 Apr 10 16:17:05 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5066aadb-3942-4eb9-9d41-ecb36836f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9fdc5d-7987-4677-81a5-82be0140ea23', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f112d14e-8bda-404c-8b9f-d1c28218d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Volume volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 (5f9fdc5d-7987-4677-81a5-82be0140ea23): created successfully Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f112d14e-8bda-404c-8b9f-d1c28218d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Flow 'volume_create_manager' (30646fde-3eb5-4022-9437-8be0062ced59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3ecc9dab-0bd5-4cf5-8151-e4f15d348dc1 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Created volume successfully. Apr 10 16:17:06 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 1 in 0.780s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Downloaded image 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume 179add58-3dcc-4906-919d-104b54107992 successfully. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 for user 6fd91ab345ec470eacce67c6c20e633a is deleted. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Marking volume 179add58-3dcc-4906-919d-104b54107992 as bootable. {{(pid=82117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Copying metadata from image 64fc5a94-65e7-4041-898d-7b63047838a6 to 179add58-3dcc-4906-919d-104b54107992. {{(pid=82117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Creating volume glance metadata for volume 179add58-3dcc-4906-919d-104b54107992 backed by image 64fc5a94-65e7-4041-898d-7b63047838a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 16:17:06 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "cinder-5f9fdc5d-7987-4677-81a5-82be0140ea23-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5" returned: 0 in 0.807s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "cinder-5f9fdc5d-7987-4677-81a5-82be0140ea23-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:06 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 Apr 10 16:17:06 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f30b02-07fd-4377-a61f-e9a2f94b902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179add58-3dcc-4906-919d-104b54107992', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e6d69-9c98-46ae-b28c-6b57cf2786b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:06 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Volume volume-179add58-3dcc-4906-919d-104b54107992 (179add58-3dcc-4906-919d-104b54107992): created successfully Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e6d69-9c98-46ae-b28c-6b57cf2786b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Flow 'volume_create_manager' (e0c85324-aa9c-488a-9611-24387b4391e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "cinder-quobyte-5f9fdc5d-7987-4677-81a5-82be0140ea23" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-b2acc53f-4cc4-4e4b-b523-01fec550640a tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Created volume successfully. Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "cinder-quobyte-5f9fdc5d-7987-4677-81a5-82be0140ea23" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed080009-ff50-4f41-969d-95c06f2e4d16]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:06 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 Apr 10 16:17:06 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:07 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64" returned: 0 in 0.737s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:07 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64 Apr 10 16:17:07 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:07 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23" returned: 0 in 0.627s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:07 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23 Apr 10 16:17:07 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:07 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5f9fdc5d-7987-4677-81a5-82be0140ea23" returned: 0 in 0.475s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "cinder-quobyte-5f9fdc5d-7987-4677-81a5-82be0140ea23" released by "delete_volume" :: held 1.135s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Created reservations ['37d7da15-94ae-4118-92dc-de5bf7b1c63e', 'c005418c-bd07-4bc4-88dc-75a270d380d8', 'b0b4ce6e-af48-4654-8d67-d7343c549631', 'dd2fc5a8-cfef-4f4b-9862-ac17164f4186'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:07 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5.16b32097-a46a-4e8c-86c1-0b5e4c348e64" returned: 0 in 0.592s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-quobyte-16b32097-a46a-4e8c-86c1-0b5e4c348e64" released by "_delete_snapshot" :: held 3.038s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-quobyte-2cd0d405-2631-4495-bc0b-a7927d3a46f5" released by "delete_snapshot" :: held 3.054s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:07 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:07 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:07 devstack cinder-volume[82117]: WARNING cinder.quota [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Created reservations ['051a1ee7-cf03-4a21-9d9c-11bc68cf88fe', '64a2f9f5-3ec5-4d38-9a82-a3b668172c8d', '80300ae6-b725-4d2a-bf8a-862c6203f078', '1b08ed2d-d87c-4b98-9c42-00e76811d2f8'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:07 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Delete snapshot completed successfully. Apr 10 16:17:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8da972c5-2966-4beb-b9c6-c3e6478b1dc8 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-16b32097-a46a-4e8c-86c1-0b5e4c348e64-delete_snapshot" released by "delete_snapshot" :: held 3.166s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:08 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.493s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:08 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Deleted volume successfully. Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9645857-cbef-44bd-9da7-efcdafff595a tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "cinder-5f9fdc5d-7987-4677-81a5-82be0140ea23-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa1952-1a4c-4594-8613-382ca1e062b4]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:08 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:08 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Flow 'volume_create_manager' (57398d15-dc96-4825-ac95-0365d9c6b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bf77e4-0cc2-4f3a-ba48-e4b37a13c9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bf77e4-0cc2-4f3a-ba48-e4b37a13c9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1223492182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd235c81-fd5e-4392-b5db-6caff92e0117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd7670780e443c69aa205fb60ccaddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:09Z,use_quota=True,user_id='b06aaa77e4674a3d803b81c7952c5190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6659cdd5-77c9-4f90-bae7-9f95d141532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6659cdd5-77c9-4f90-bae7-9f95d141532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb9944a-f6a4-4168-84c4-fdca5b95fcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb9944a-f6a4-4168-84c4-fdca5b95fcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd235c81-fd5e-4392-b5db-6caff92e0117', 'volume_name': 'volume-dd235c81-fd5e-4392-b5db-6caff92e0117', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1174b387-b79a-41ea-8c12-d86d629d523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1174b387-b79a-41ea-8c12-d86d629d523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebca7b8-1506-473a-b38f-90ec12516c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:08 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Volume dd235c81-fd5e-4392-b5db-6caff92e0117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd235c81-fd5e-4392-b5db-6caff92e0117', 'volume_size': 1} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "cinder-2cd0d405-2631-4495-bc0b-a7927d3a46f5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-2cd0d405-2631-4495-bc0b-a7927d3a46f5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "cinder-quobyte-2cd0d405-2631-4495-bc0b-a7927d3a46f5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-quobyte-2cd0d405-2631-4495-bc0b-a7927d3a46f5" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003f3fb-ca3f-497d-b995-cb3986ca5a00]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:09 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 0 in 0.544s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:09 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 Apr 10 16:17:09 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:09 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:09 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:09 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5" returned: 0 in 0.526s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:09 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 1 in 0.535s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.112s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:09 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5 Apr 10 16:17:09 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1223492182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd235c81-fd5e-4392-b5db-6caff92e0117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd7670780e443c69aa205fb60ccaddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:09Z,use_quota=True,user_id='b06aaa77e4674a3d803b81c7952c5190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Creating volume dd235c81-fd5e-4392-b5db-6caff92e0117 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:09 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:09 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 1073741824 Apr 10 16:17:09 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:09 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79', 'name': 'volume-179add58-3dcc-4906-919d-104b54107992', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ace0650-e6c3-4129-abe5-ddc080032a81', 'enforce_multipath': True} {{(pid=82117) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 16:17:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-192d9fad-b8b9-4b51-b585-9078d334ebeb req-ce240125-85f9-47da-94b5-d6fa4b4a8668 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] attachment_update completed successfully. Apr 10 16:17:10 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2cd0d405-2631-4495-bc0b-a7927d3a46f5" returned: 0 in 0.491s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-quobyte-2cd0d405-2631-4495-bc0b-a7927d3a46f5" released by "delete_volume" :: held 1.049s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Created reservations ['71dc2fd1-b4a2-4a25-b4c2-86835a01c7e8', '44bad87d-31d8-4201-9f2e-61fef9f804c6', 'd55d8e26-1dff-4abf-88b7-838bbd06e466', 'cfbeb036-535b-4ba2-a046-640d7d92a840'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:10 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:10 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:10 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 1073741824" returned: 0 in 0.642s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:10 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 Apr 10 16:17:10 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:10 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.557s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:10 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Deleted volume successfully. Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c9c9af31-8bef-48eb-9fc1-4f94a51b3b47 tempest-SnapshotMetadataTestJSON-1500848821 None] Lock "cinder-2cd0d405-2631-4495-bc0b-a7927d3a46f5-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:10 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117" returned: 0 in 0.643s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebca7b8-1506-473a-b38f-90ec12516c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd235c81-fd5e-4392-b5db-6caff92e0117', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e142ea5e-0fe8-47dd-bf38-844edadd44ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:10 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Volume volume-dd235c81-fd5e-4392-b5db-6caff92e0117 (dd235c81-fd5e-4392-b5db-6caff92e0117): created successfully Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e142ea5e-0fe8-47dd-bf38-844edadd44ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Flow 'volume_create_manager' (57398d15-dc96-4825-ac95-0365d9c6b663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:10 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-740d258c-f77b-4005-8bfb-8a6238794c09 tempest-VolumeQuotasAdminTestJSON-1058814905 None] Created volume successfully. Apr 10 16:17:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e69a84c1-3c3e-4f41-b2a9-ad1ea8570407 tempest-VolumeQuotasAdminTestJSON-257722353 None] Transfer volume completed successfully. Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Flow 'volume_create_manager' (cfea17dc-e5ef-4bb3-bf0a-ecf8e1d2de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e62bc2-c70e-4d37-a641-e8fe08a07fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e62bc2-c70e-4d37-a641-e8fe08a07fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1865805908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45291a9d8d3c4bd394198d951bc529c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:13Z,use_quota=True,user_id='68ddb2ae4d6f4d9e9efac8cbd0253712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a87b22-0b2c-415e-b37d-d4897236af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a87b22-0b2c-415e-b37d-d4897236af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60399ee6-7743-41f0-a8e4-64d1aa293269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60399ee6-7743-41f0-a8e4-64d1aa293269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3', 'volume_name': 'volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaf5de7-cb25-4e7b-aa1b-ff837f9e7be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaf5de7-cb25-4e7b-aa1b-ff837f9e7be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dbf177-0492-4ff6-827a-e7a13d2c4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:13 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Volume f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3', 'volume_size': 1} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1865805908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45291a9d8d3c4bd394198d951bc529c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:13Z,use_quota=True,user_id='68ddb2ae4d6f4d9e9efac8cbd0253712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Creating volume f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:13 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:13 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 1073741824 Apr 10 16:17:13 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Acquiring lock "cinder-dd235c81-fd5e-4392-b5db-6caff92e0117-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Lock "cinder-dd235c81-fd5e-4392-b5db-6caff92e0117-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Acquiring lock "cinder-quobyte-dd235c81-fd5e-4392-b5db-6caff92e0117" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Lock "cinder-quobyte-dd235c81-fd5e-4392-b5db-6caff92e0117" acquired by "delete_volume" :: waited 0.025s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f4879-3c76-4e2e-89ec-956b7a366ff1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:13 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 Apr 10 16:17:13 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:14 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 1073741824" returned: 0 in 0.842s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:14 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 Apr 10 16:17:14 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:14 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117" returned: 0 in 0.859s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:14 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117 Apr 10 16:17:14 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:15 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" returned: 0 in 0.917s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dbf177-0492-4ff6-827a-e7a13d2c4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236108e8-af74-4204-a086-e08fbe4afcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:15 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Volume volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 (f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3): created successfully Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236108e8-af74-4204-a086-e08fbe4afcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Flow 'volume_create_manager' (cfea17dc-e5ef-4bb3-bf0a-ecf8e1d2de7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5c5732b5-2a28-4b3d-a2cd-ccae6136410f tempest-VolumesDeleteCascade-698994740 None] Created volume successfully. Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:15 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-dd235c81-fd5e-4392-b5db-6caff92e0117" returned: 0 in 0.750s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:15 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:15 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Lock "cinder-quobyte-dd235c81-fd5e-4392-b5db-6caff92e0117" released by "delete_volume" :: held 1.688s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Created reservations ['ea784cc1-bc59-425f-b785-1140273be3f6', '4bec63cb-3087-487f-9bf4-b22a61a7463c', '2cc9b846-5549-4e94-a769-5fe348b891a9', '924d4c03-aa1f-4324-a4a6-ea15751ae465'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:15 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:15 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Creating offline snapshot 5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 of volume f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fdc16-6ac3-4f05-a0de-fb9d255a6659]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:15 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 Apr 10 16:17:15 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:16 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.016s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:16 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:16 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.984s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:16 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:16 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Deleted volume successfully. Apr 10 16:17:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-77d7cd7d-00f2-4583-88fb-c612e0a69137 tempest-VolumeQuotasAdminTestJSON-1756073371 None] Lock "cinder-dd235c81-fd5e-4392-b5db-6caff92e0117-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:17 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" returned: 0 in 1.262s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:17 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 1G Apr 10 16:17:17 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:17 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 1G" returned: 0 in 0.832s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:17 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:17 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:18 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.669s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:18 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 is being set with open permissions: ugo+rw Apr 10 16:17:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:18 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:18 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:19 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.524s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:19 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info Apr 10 16:17:19 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:19 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:19 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info is being set with open permissions: ugo+rw Apr 10 16:17:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:19 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info Apr 10 16:17:19 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:20 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.info" returned: 0 in 0.521s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.516s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:20 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8b214faa-6f15-4853-a676-d7c4905abce6 tempest-VolumesDeleteCascade-698994740 None] Create snapshot completed successfully Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Creating offline snapshot 1e8176a7-1862-49b8-8acb-48c445fb9fdc of volume f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[df401a11-ab06-419d-b113-aba268c125ad]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:21 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:21 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:21 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.741s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:21 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc 1G Apr 10 16:17:21 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Flow 'volume_create_manager' (f6f92986-2115-4d87-9144-c9f0804d155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280fd376-51d8-4c70-acae-f82c258f06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280fd376-51d8-4c70-acae-f82c258f06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1122365318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe655dc-ebef-4712-86ac-f833440a017e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d18383ab0541108e07c916aeb41a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:22Z,use_quota=True,user_id='4e28bf299be1443582571bfe85c7d37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb2a85b3-33d6-4fae-b38a-5c6170c98f62),volume_type_id=eb2a85b3-33d6-4fae-b38a-5c6170c98f62)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a798d75f-3a48-48a1-8eca-5ff4f2e042b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a798d75f-3a48-48a1-8eca-5ff4f2e042b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd029db-a208-4893-abef-7e177cb3213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd029db-a208-4893-abef-7e177cb3213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe655dc-ebef-4712-86ac-f833440a017e', 'volume_name': 'volume-bbe655dc-ebef-4712-86ac-f833440a017e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6cbf11-56ff-4e79-80b9-db498fb1a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6cbf11-56ff-4e79-80b9-db498fb1a44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52217ab-e6e3-472f-9b9b-4b34148e8e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:22 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Volume bbe655dc-ebef-4712-86ac-f833440a017e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe655dc-ebef-4712-86ac-f833440a017e', 'volume_size': 1} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:22 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc 1G" returned: 0 in 0.740s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:22 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc Apr 10 16:17:22 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:23 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc" returned: 0 in 0.647s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:23 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc is being set with open permissions: ugo+rw Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:23 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc Apr 10 16:17:23 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:23 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc" returned: 0 in 0.521s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1122365318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe655dc-ebef-4712-86ac-f833440a017e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d18383ab0541108e07c916aeb41a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:22Z,use_quota=True,user_id='4e28bf299be1443582571bfe85c7d37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb2a85b3-33d6-4fae-b38a-5c6170c98f62),volume_type_id=eb2a85b3-33d6-4fae-b38a-5c6170c98f62)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Creating volume bbe655dc-ebef-4712-86ac-f833440a017e {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:23 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:23 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e 1073741824 Apr 10 16:17:23 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:23 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0d1db5b5-ccc5-45ad-a3f7-81d471fc0676 tempest-VolumesDeleteCascade-698994740 None] Create snapshot completed successfully Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Performing cascade delete. {{(pid=82117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-1e8176a7-1862-49b8-8acb-48c445fb9fdc-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-1e8176a7-1862-49b8-8acb-48c445fb9fdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-1e8176a7-1862-49b8-8acb-48c445fb9fdc" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-1e8176a7-1862-49b8-8acb-48c445fb9fdc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Deleting offline snapshot 1e8176a7-1862-49b8-8acb-48c445fb9fdc of volume f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:17:24 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] snapshot_file for this snap is: volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e 1073741824" returned: 0 in 0.526s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2306a7c8-0543-45d5-9997-a8f1ffd7c63c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:24 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e Apr 10 16:17:24 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:24 devstack sudo[85633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc Apr 10 16:17:24 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:24 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:24 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52217ab-e6e3-472f-9b9b-4b34148e8e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe655dc-ebef-4712-86ac-f833440a017e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79ddf28-4287-451e-8b83-42bf23f4c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc" returned: 0 in 0.498s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:24 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Volume volume-bbe655dc-ebef-4712-86ac-f833440a017e (bbe655dc-ebef-4712-86ac-f833440a017e): created successfully Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79ddf28-4287-451e-8b83-42bf23f4c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Flow 'volume_create_manager' (f6f92986-2115-4d87-9144-c9f0804d155e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c38ff1-6807-404e-8422-d415f3bbf9ac]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6587626e-c279-4ba2-b837-c9618a174b7b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Created volume successfully. Apr 10 16:17:24 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:24 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:25 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.520s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:25 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc Apr 10 16:17:25 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:25 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc" returned: 0 in 0.595s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:25 devstack sudo[85651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:25 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:26 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc Apr 10 16:17:26 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:26 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.1e8176a7-1862-49b8-8acb-48c445fb9fdc" returned: 0 in 0.435s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-1e8176a7-1862-49b8-8acb-48c445fb9fdc" released by "_delete_snapshot" :: held 2.108s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" released by "delete_snapshot" :: held 2.118s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Created reservations ['3acf311b-4260-4f4c-acb8-48df3e66270d', '4abbfde8-76d4-45d2-a23d-db5249fc55be', '5f83ae61-2254-47ff-958e-356ae56e638d', 'a01775e5-b4f2-41e0-a968-8364bb5a681f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:26 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-623a5825-92cf-40c8-bc64-befa9521774b tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Retype volume completed successfully. Apr 10 16:17:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Delete snapshot completed successfully. Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-1e8176a7-1862-49b8-8acb-48c445fb9fdc-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Deleting offline snapshot 5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 of volume f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] snapshot_file for this snap is: volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eba2012-e6e1-4038-9a10-db73e0f0957f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:26 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:26 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:27 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.496s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[57463765-4a0d-4073-84ed-4acc99767acd]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:27 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 Apr 10 16:17:27 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Acquiring lock "cinder-bbe655dc-ebef-4712-86ac-f833440a017e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "cinder-bbe655dc-ebef-4712-86ac-f833440a017e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Acquiring lock "cinder-quobyte-bbe655dc-ebef-4712-86ac-f833440a017e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "cinder-quobyte-bbe655dc-ebef-4712-86ac-f833440a017e" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92e302-085b-4761-bab8-ff3df8cbde97]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:27 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e Apr 10 16:17:27 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:27 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" returned: 0 in 0.543s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:27 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:27 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:27 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e" returned: 0 in 0.593s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:27 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e Apr 10 16:17:27 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:28 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.915s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:28 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96 Apr 10 16:17:28 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:28 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bbe655dc-ebef-4712-86ac-f833440a017e" returned: 0 in 0.907s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "cinder-quobyte-bbe655dc-ebef-4712-86ac-f833440a017e" released by "delete_volume" :: held 1.527s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:28 devstack cinder-volume[82117]: WARNING cinder.quota [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:17:28 devstack cinder-volume[82117]: WARNING cinder.quota [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Created reservations ['74082e5b-d764-459e-91a9-ea037be4aa5a', '6b756ac4-32e2-4c82-bb52-7c47993b2113', 'c061bb1a-6bf3-421d-8f98-1514b27b3d72', 'ca7527de-b074-43c1-857f-880dc6fbe9d5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:28 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:28 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:29 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3.5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" returned: 0 in 0.829s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96" released by "_delete_snapshot" :: held 2.883s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" released by "delete_snapshot" :: held 2.897s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Created reservations ['78dde19a-177e-4bf2-838c-374b27de3c08', '1b2dfbba-4abe-4358-b1a5-991a85ce3462', 'b55dd5da-2547-4c4e-b6f7-cd9bdb73dd2b', '98134fa4-4d6c-4003-9a52-4fb5497b4e10'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Delete snapshot completed successfully. Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-5a4438e0-e58a-41c2-9c4f-ffaf0ac11e96-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Snapshots deleted, issuing volume delete {{(pid=82117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:29 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.756s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Deleted volume successfully. Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-753db7a3-65da-4041-8177-c97082640b9c tempest-VolumeRetypeWithoutMigrationTest-1733815530 None] Lock "cinder-bbe655dc-ebef-4712-86ac-f833440a017e-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1984ee0b-0908-4a28-8b64-daa267233fd3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:29 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 Apr 10 16:17:29 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:30 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" returned: 0 in 1.095s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:30 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3 Apr 10 16:17:30 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:31 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" returned: 0 in 0.692s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3" released by "delete_volume" :: held 1.945s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Created reservations ['d59552a2-fd6f-4362-83f8-c3aaa1dcd92b', '400afd33-3e84-4b79-a59c-bbe0593ac596', 'cb9d17ad-cb99-4e1a-a703-ea618f5b846d', '4fb24dfe-39ce-42c5-97ef-e94d2e94765f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:31 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:31 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Flow 'volume_create_manager' (c435b889-2672-4a76-99cc-72b134bbfd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e06a250-e4d0-4a52-965c-5350f47efba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e06a250-e4d0-4a52-965c-5350f47efba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1903296571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03580f5d-4dd5-49bd-b269-67dd86c98382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45291a9d8d3c4bd394198d951bc529c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:33Z,use_quota=True,user_id='68ddb2ae4d6f4d9e9efac8cbd0253712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44019815-b9f7-4330-9035-f15b7c50bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44019815-b9f7-4330-9035-f15b7c50bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0904f3a9-6fd6-4109-a12a-670b5045514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0904f3a9-6fd6-4109-a12a-670b5045514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03580f5d-4dd5-49bd-b269-67dd86c98382', 'volume_name': 'volume-03580f5d-4dd5-49bd-b269-67dd86c98382', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e50a37f-341c-469c-86e7-6c795abd998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e50a37f-341c-469c-86e7-6c795abd998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386184b3-1f4f-4637-9b64-06cf05655061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:32 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Volume 03580f5d-4dd5-49bd-b269-67dd86c98382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03580f5d-4dd5-49bd-b269-67dd86c98382', 'volume_size': 1} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1903296571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03580f5d-4dd5-49bd-b269-67dd86c98382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45291a9d8d3c4bd394198d951bc529c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:33Z,use_quota=True,user_id='68ddb2ae4d6f4d9e9efac8cbd0253712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Creating volume 03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:32 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:32 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 1073741824 Apr 10 16:17:32 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:33 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:33 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Deleted volume successfully. Apr 10 16:17:33 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a5e2063-5070-4158-9600-ba53048044b7 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-f6cc5122-5bcc-4bfc-83f2-fef6ff3ac2c3-delete_volume" released by "delete_volume" :: held 9.058s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:33 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 1073741824" returned: 0 in 1.075s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:33 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:33 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:34 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 1.146s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386184b3-1f4f-4637-9b64-06cf05655061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03580f5d-4dd5-49bd-b269-67dd86c98382', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1e2c9d-1ac0-45f5-aa19-e92fdb83e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:34 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Volume volume-03580f5d-4dd5-49bd-b269-67dd86c98382 (03580f5d-4dd5-49bd-b269-67dd86c98382): created successfully Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1e2c9d-1ac0-45f5-aa19-e92fdb83e212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Flow 'volume_create_manager' (c435b889-2672-4a76-99cc-72b134bbfd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d7c48422-3f74-4868-aece-792abd8eb1bf tempest-VolumesDeleteCascade-698994740 None] Created volume successfully. Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Flow 'volume_create_manager' (64ea27a7-83a8-4e94-a704-87251ccb70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b517b5f8-1e4b-4b68-947e-9a0f11cb9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b517b5f8-1e4b-4b68-947e-9a0f11cb9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-450744938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bd9c67-6ed6-428c-8f77-218057efad71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae56451d004e7b936119053e56c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:36Z,use_quota=True,user_id='8fd78f437224493c9631da27ce004a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d87d2d5-9a26-4643-9ec5-d949810a950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d87d2d5-9a26-4643-9ec5-d949810a950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059aa15e-18d2-40f9-841f-5af8bdc4775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059aa15e-18d2-40f9-841f-5af8bdc4775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71bd9c67-6ed6-428c-8f77-218057efad71', 'volume_name': 'volume-71bd9c67-6ed6-428c-8f77-218057efad71', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96e8118-a068-475d-ab0b-b64e117a74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96e8118-a068-475d-ab0b-b64e117a74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f09279-0838-4eee-8c41-8f7a9adabe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:35 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Volume 71bd9c67-6ed6-428c-8f77-218057efad71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71bd9c67-6ed6-428c-8f77-218057efad71', 'volume_size': 1} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-450744938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bd9c67-6ed6-428c-8f77-218057efad71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae56451d004e7b936119053e56c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:36Z,use_quota=True,user_id='8fd78f437224493c9631da27ce004a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Creating volume 71bd9c67-6ed6-428c-8f77-218057efad71 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:35 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:35 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 1073741824 Apr 10 16:17:35 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:36 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 1073741824" returned: 0 in 0.778s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:36 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 Apr 10 16:17:36 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:37 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71" returned: 0 in 0.533s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.194s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f09279-0838-4eee-8c41-8f7a9adabe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bd9c67-6ed6-428c-8f77-218057efad71', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3b732d-3b99-4b50-90e7-acd6d5cdf4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:37 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Volume volume-71bd9c67-6ed6-428c-8f77-218057efad71 (71bd9c67-6ed6-428c-8f77-218057efad71): created successfully Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3b732d-3b99-4b50-90e7-acd6d5cdf4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Flow 'volume_create_manager' (64ea27a7-83a8-4e94-a704-87251ccb70ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7d9476be-1dca-4839-8eed-489d994f9956 tempest-VolumesServicesTestJSON-1620071868 None] Created volume successfully. Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Creating offline snapshot f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d of volume 03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a6e1d-d18c-48bf-b659-629d9a9c9510]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:37 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:37 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Acquiring lock "cinder-71bd9c67-6ed6-428c-8f77-218057efad71-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Lock "cinder-71bd9c67-6ed6-428c-8f77-218057efad71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Acquiring lock "cinder-quobyte-71bd9c67-6ed6-428c-8f77-218057efad71" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:38 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 0.866s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Lock "cinder-quobyte-71bd9c67-6ed6-428c-8f77-218057efad71" acquired by "delete_volume" :: waited 0.037s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:38 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d 1G Apr 10 16:17:38 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce75c17b-bcc5-4fa6-bbfd-44c245d6c4af]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:38 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 Apr 10 16:17:38 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:38 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71" returned: 0 in 0.668s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:38 devstack sudo[85886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71 Apr 10 16:17:38 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:38 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d 1G" returned: 0 in 0.819s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03580f5d-4dd5-49bd-b269-67dd86c98382 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:39 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03580f5d-4dd5-49bd-b269-67dd86c98382 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d Apr 10 16:17:39 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:39 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03580f5d-4dd5-49bd-b269-67dd86c98382 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" returned: 0 in 0.895s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:39 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d is being set with open permissions: ugo+rw Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:39 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bd9c67-6ed6-428c-8f77-218057efad71" returned: 0 in 1.019s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:39 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d Apr 10 16:17:39 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Lock "cinder-quobyte-71bd9c67-6ed6-428c-8f77-218057efad71" released by "delete_volume" :: held 1.732s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Created reservations ['e83fe5f0-47f5-4601-a918-d31c743b842e', '5f82e9fd-cdc9-44b1-9268-e957d317646a', '6c3e02a3-81ad-4118-ae5c-22e96545cf82', 'ebcd1d0a-2114-44e6-90b5-d512da1244f1'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:40 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:40 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:40 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" returned: 0 in 0.513s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:40 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info Apr 10 16:17:40 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:40 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.619s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:40 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Deleted volume successfully. Apr 10 16:17:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-4f8e4eb7-d278-4d1b-b06c-f92305ba2082 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Terminate volume connection completed successfully. Apr 10 16:17:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-4f8e4eb7-d278-4d1b-b06c-f92305ba2082 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Deleting attachment 9ace0650-e6c3-4129-abe5-ddc080032a81. {{(pid=82117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 16:17:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6ce523c0-778d-4868-b375-fff741fd8dec tempest-VolumesServicesTestJSON-1620071868 None] Lock "cinder-71bd9c67-6ed6-428c-8f77-218057efad71-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:41 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info" returned: 0 in 0.677s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:41 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info is being set with open permissions: ugo+rw Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:41 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info Apr 10 16:17:41 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "cinder-179add58-3dcc-4906-919d-104b54107992-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-179add58-3dcc-4906-919d-104b54107992-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "cinder-quobyte-179add58-3dcc-4906-919d-104b54107992" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-quobyte-179add58-3dcc-4906-919d-104b54107992" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c032498-6381-457c-96bb-ce67f21f76e6]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:41 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:41 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:41 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.info" returned: 0 in 0.623s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.524s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-82c5ced4-e086-465c-af79-0be64bc73e6d tempest-VolumesDeleteCascade-698994740 None] Create snapshot completed successfully Apr 10 16:17:42 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 0 in 0.705s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:42 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:42 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:42 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 1 in 0.711s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:42 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992 Apr 10 16:17:42 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Flow 'volume_create_manager' (167f6c41-aaab-4814-8868-a72ec8c2d13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72f6ade-2485-4db2-a22e-cc0c81a69a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72f6ade-2485-4db2-a22e-cc0c81a69a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1826358968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0642ba0c-1fc0-4c9b-be0c-ba814bac48b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45291a9d8d3c4bd394198d951bc529c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:43Z,use_quota=True,user_id='68ddb2ae4d6f4d9e9efac8cbd0253712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11e41c6-cbd6-4361-8d8f-21dab10841fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11e41c6-cbd6-4361-8d8f-21dab10841fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed02adaf-20c5-49d7-a746-4f2c3dd62c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed02adaf-20c5-49d7-a746-4f2c3dd62c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0642ba0c-1fc0-4c9b-be0c-ba814bac48b6', 'volume_name': 'volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6', 'volume_size': 1, 'snapshot_id': 'f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059ddf92-3d4d-4d67-9181-e55630fe0a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059ddf92-3d4d-4d67-9181-e55630fe0a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bdf655-a77d-40ae-b279-a30a17d291f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:42 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Volume 0642ba0c-1fc0-4c9b-be0c-ba814bac48b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6', 'volume_size': 1, 'snapshot_id': 'f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d'} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Creating volume 0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 from snapshot f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] snapshot: f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d, volume: 0642ba0c-1fc0-4c9b-be0c-ba814bac48b6, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff178201-9507-4687-bee0-792d8ff23b70]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:43 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d Apr 10 16:17:43 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:43 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-179add58-3dcc-4906-919d-104b54107992" returned: 0 in 0.624s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-quobyte-179add58-3dcc-4906-919d-104b54107992" released by "delete_volume" :: held 2.089s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.quota [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Created reservations ['391aa210-0e6f-4594-9cf9-cea71ba6ff83', '217f1467-04cf-443f-8873-04f38e4d72ba', '7da9f5dc-5686-4191-a640-f628e8544027', '1421ce7f-38de-4a36-8ef8-666cd2260dbd'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:43 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:43 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:43 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" returned: 0 in 0.762s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03580f5d-4dd5-49bd-b269-67dd86c98382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3fdaff-2d4a-4213-a741-c82fda890392]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:43 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:43 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:44 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.742s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:44 devstack cinder-volume[82117]: DEBUG cinder.manager [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Deleted volume successfully. Apr 10 16:17:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-ab33f12d-1d91-4b1c-a69f-08944a32d495 req-e9dae7fb-c981-4f6d-8750-27670fa2fdcc tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-179add58-3dcc-4906-919d-104b54107992-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:44 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 0.590s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:44 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:17:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:44 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 Apr 10 16:17:44 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:48 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" returned: 0 in 4.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:48 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8566e3-519d-469c-9ba0-eb06a3dbbf1b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:48 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:48 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:49 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 1.136s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:49 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:17:49 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Converted 1024.00 MB image at 229.47 MB/s Apr 10 16:17:49 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 is being set with open permissions: ugo+rw Apr 10 16:17:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:49 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 Apr 10 16:17:49 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:50 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" released by "_copy_volume_from_snapshot" :: held 7.619s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" released by "_create_volume_from_snapshot" :: held 7.637s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.649s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=117,cinder:UPDATE=97,cinder:INSERT=43,cinder:DELETE=9 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bdf655-a77d-40ae-b279-a30a17d291f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6', 'volume_size': 1, 'snapshot_id': 'f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8619c3-3ad3-4318-b389-3892e2991fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:50 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Volume volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 (0642ba0c-1fc0-4c9b-be0c-ba814bac48b6): created successfully Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8619c3-3ad3-4318-b389-3892e2991fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Flow 'volume_create_manager' (167f6c41-aaab-4814-8868-a72ec8c2d13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:50 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-af29ef68-2d0a-42c8-a595-fe33f6743213 tempest-VolumesDeleteCascade-698994740 None] Created volume successfully. Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-03580f5d-4dd5-49bd-b269-67dd86c98382-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-03580f5d-4dd5-49bd-b269-67dd86c98382-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Performing cascade delete. {{(pid=82117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-03580f5d-4dd5-49bd-b269-67dd86c98382" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-03580f5d-4dd5-49bd-b269-67dd86c98382" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Deleting offline snapshot f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d of volume 03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] snapshot_file for this snap is: volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1eace9-aac0-4c93-bfe0-4e39036a855d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:51 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d Apr 10 16:17:51 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:51 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" returned: 0 in 0.784s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03580f5d-4dd5-49bd-b269-67dd86c98382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5feb645-338b-494a-ae6c-c46641e661ed]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:52 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:52 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=126,cinder:SELECT=94,cinder:DELETE=11,cinder:INSERT=21 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Flow 'volume_create_manager' (4a8482dc-702e-4903-826d-307dbec363c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b99b4a-c75c-446e-aa6a-77c712191666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b99b4a-c75c-446e-aa6a-77c712191666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-420592010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dee715-7471-4b59-b081-edf2693e97d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9739e715b5f42d18b05687117f8de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:53Z,use_quota=True,user_id='a4069bf525cd423caaa74f16396a9535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0c830b-2b69-40a4-9210-b33f0bba362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0c830b-2b69-40a4-9210-b33f0bba362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afa30b1-ba8a-4d76-a3ac-d2b1609216c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afa30b1-ba8a-4d76-a3ac-d2b1609216c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01dee715-7471-4b59-b081-edf2693e97d9', 'volume_name': 'volume-01dee715-7471-4b59-b081-edf2693e97d9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d63f2b-e4dc-4554-ab47-c965e9aa9ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d63f2b-e4dc-4554-ab47-c965e9aa9ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0149433a-3561-455d-b1fa-f436dd54aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:52 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Volume 01dee715-7471-4b59-b081-edf2693e97d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01dee715-7471-4b59-b081-edf2693e97d9', 'volume_size': 1} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-420592010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dee715-7471-4b59-b081-edf2693e97d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9739e715b5f42d18b05687117f8de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:53Z,use_quota=True,user_id='a4069bf525cd423caaa74f16396a9535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Creating volume 01dee715-7471-4b59-b081-edf2693e97d9 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:52 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:52 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 0.752s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:52 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d Apr 10 16:17:52 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 1073741824 Apr 10 16:17:52 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:52 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:53 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" returned: 0 in 0.543s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:53 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d Apr 10 16:17:53 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:53 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 1073741824" returned: 0 in 0.665s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:53 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 Apr 10 16:17:53 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:53 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382.f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" returned: 0 in 0.483s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d" released by "_delete_snapshot" :: held 2.658s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-03580f5d-4dd5-49bd-b269-67dd86c98382" released by "delete_snapshot" :: held 2.671s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Created reservations ['63146d1c-bd67-43b1-87e8-849ced95557e', 'e0797068-073a-417b-8bba-978056a7e7f0', '00e9a630-ae77-46f5-8fc9-6396a7a13fe3', '1d8c8759-3394-4829-938d-2c2fd00d85e3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Delete snapshot completed successfully. Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-f5a33d97-e12c-45c9-8cfe-ef23fc51eb3d-delete_snapshot" released by "delete_snapshot" :: held 2.804s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Snapshots deleted, issuing volume delete {{(pid=82117) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-03580f5d-4dd5-49bd-b269-67dd86c98382" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-03580f5d-4dd5-49bd-b269-67dd86c98382" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6532377-d331-47b0-89ea-0a804b53c768]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:53 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9" returned: 0 in 0.556s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0149433a-3561-455d-b1fa-f436dd54aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01dee715-7471-4b59-b081-edf2693e97d9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc80f52f-b671-4885-968a-4f522c32217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:53 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Volume volume-01dee715-7471-4b59-b081-edf2693e97d9 (01dee715-7471-4b59-b081-edf2693e97d9): created successfully Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc80f52f-b671-4885-968a-4f522c32217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Flow 'volume_create_manager' (4a8482dc-702e-4903-826d-307dbec363c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0b463358-2943-4bb1-8bf6-6abcf779ec7e tempest-VolumesListAdminTestJSON-1574522681 None] Created volume successfully. Apr 10 16:17:54 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:54 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:54 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 0.659s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:54 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382 Apr 10 16:17:54 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Flow 'volume_create_manager' (cf6a17b7-c89a-471e-9662-8848d4c9be8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afd8010-babe-4a74-b012-c0d5393217d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afd8010-babe-4a74-b012-c0d5393217d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1435042315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10efc942-25c5-44de-97bd-04c381e690b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9739e715b5f42d18b05687117f8de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:55Z,use_quota=True,user_id='a4069bf525cd423caaa74f16396a9535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a6d490-74a0-4275-b281-8b33fe2d2d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a6d490-74a0-4275-b281-8b33fe2d2d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08976d2-6479-46fb-8b08-d87af1380229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08976d2-6479-46fb-8b08-d87af1380229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10efc942-25c5-44de-97bd-04c381e690b6', 'volume_name': 'volume-10efc942-25c5-44de-97bd-04c381e690b6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf725b15-4ee4-4d83-91df-0c07ad7da8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf725b15-4ee4-4d83-91df-0c07ad7da8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab58ca1-a50d-4c71-ab40-aedeba3b333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:55 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Volume 10efc942-25c5-44de-97bd-04c381e690b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10efc942-25c5-44de-97bd-04c381e690b6', 'volume_size': 1} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1435042315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10efc942-25c5-44de-97bd-04c381e690b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9739e715b5f42d18b05687117f8de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:55Z,use_quota=True,user_id='a4069bf525cd423caaa74f16396a9535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Creating volume 10efc942-25c5-44de-97bd-04c381e690b6 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:55 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:55 devstack sudo[86147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 1073741824 Apr 10 16:17:55 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:55 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-03580f5d-4dd5-49bd-b269-67dd86c98382" returned: 0 in 0.558s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-03580f5d-4dd5-49bd-b269-67dd86c98382" released by "delete_volume" :: held 1.261s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Created reservations ['18d87d8c-09c3-4601-bfbf-404ecaa3d7a8', 'ef116bed-e2d9-4692-9bae-f950a7ebabe5', '00a828ea-0555-4dc7-9956-807f3fbe2371', '8059e4c6-da38-4b2b-bc5f-a77cbcfc1a65'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:55 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:55 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "cinder-quobyte-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" acquired by "delete_volume" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec725a3-0d5f-4010-b6c0-ff4289225c98]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:55 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 Apr 10 16:17:55 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:55 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 1073741824" returned: 0 in 0.831s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:55 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 Apr 10 16:17:55 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:56 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.924s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Deleted volume successfully. Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-af182846-c699-4e9c-a59d-025e737d3b04 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-03580f5d-4dd5-49bd-b269-67dd86c98382-delete_volume" released by "delete_volume" :: held 5.148s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:56 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" returned: 0 in 0.771s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:56 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6 Apr 10 16:17:56 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:56 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6" returned: 0 in 0.736s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab58ca1-a50d-4c71-ab40-aedeba3b333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10efc942-25c5-44de-97bd-04c381e690b6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc63413-dae1-425f-80aa-24b8ae96d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Volume volume-10efc942-25c5-44de-97bd-04c381e690b6 (10efc942-25c5-44de-97bd-04c381e690b6): created successfully Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc63413-dae1-425f-80aa-24b8ae96d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Flow 'volume_create_manager' (cf6a17b7-c89a-471e-9662-8848d4c9be8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4e60e13d-6b7f-4709-8a72-32103fb8df48 tempest-VolumesListAdminTestJSON-1574522681 None] Created volume successfully. Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Flow 'volume_create_manager' (ba9fbe52-7f54-41fc-8731-4cff11b21b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade89173-22ac-4c48-a013-4b980b8ab30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade89173-22ac-4c48-a013-4b980b8ab30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1472413660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01495294-2313-48c3-855b-2ae47a7d0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e225753bf27641e4abbd7a1b3e0bcad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:57Z,use_quota=True,user_id='75e029a579c44945a8e05e5bebf5df1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a26980d-4d69-45d0-9523-3a303a1171af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a26980d-4d69-45d0-9523-3a303a1171af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a63772-cb6c-441a-9657-de6b5988edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a63772-cb6c-441a-9657-de6b5988edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01495294-2313-48c3-855b-2ae47a7d0037', 'volume_name': 'volume-01495294-2313-48c3-855b-2ae47a7d0037', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ed4a1-1b71-478b-9f98-c70daa821e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ed4a1-1b71-478b-9f98-c70daa821e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d80e972-919d-40a1-b40a-80b63a0d1e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Volume 01495294-2313-48c3-855b-2ae47a7d0037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01495294-2313-48c3-855b-2ae47a7d0037', 'volume_size': 1} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1472413660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01495294-2313-48c3-855b-2ae47a7d0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e225753bf27641e4abbd7a1b3e0bcad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:57Z,use_quota=True,user_id='75e029a579c44945a8e05e5bebf5df1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Creating volume 01495294-2313-48c3-855b-2ae47a7d0037 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:56 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:56 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 1073741824 Apr 10 16:17:56 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:56 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" returned: 0 in 0.549s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-quobyte-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6" released by "delete_volume" :: held 1.343s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:56 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Created reservations ['aafd34e1-3521-4b24-9d82-a9bcd82ee38f', '49fd3e67-e87d-417e-97b4-35607a2aba97', 'c44e22b1-b5af-407b-9764-cb581ba54bb4', '9814959d-bb45-480d-a82c-8be2ac77604f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-04a646ed-72da-4f2b-9ab2-7595f0f63fb0 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Terminate volume connection completed successfully. Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-04a646ed-72da-4f2b-9ab2-7595f0f63fb0 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Deleting attachment dec184ab-3bd1-4e7b-b3f4-68d8c337c90c. {{(pid=82117) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:57 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:57 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:57 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 1073741824" returned: 0 in 0.567s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:57 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 Apr 10 16:17:57 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Flow 'volume_create_manager' (0a7be687-6025-4538-9728-d947d81c836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeaa0168-b014-48db-a26e-c6e370ec49c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeaa0168-b014-48db-a26e-c6e370ec49c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1281992804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9739e715b5f42d18b05687117f8de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:57Z,use_quota=True,user_id='a4069bf525cd423caaa74f16396a9535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2840f7f3-ac54-4100-8b91-f99362f676ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2840f7f3-ac54-4100-8b91-f99362f676ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d807c5e-be6e-41e3-b8c6-f507d42befed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d807c5e-be6e-41e3-b8c6-f507d42befed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1', 'volume_name': 'volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0e4f14-3f43-4e81-9964-945ebe750c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0e4f14-3f43-4e81-9964-945ebe750c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676ff36e-308d-4e17-a3fd-a6ab0d39c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:57 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Volume bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1', 'volume_size': 1} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:57 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.564s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:17:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Deleted volume successfully. Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11caa984-0875-4e6a-8933-e3a9b4793707 tempest-VolumesDeleteCascade-698994740 None] Lock "cinder-0642ba0c-1fc0-4c9b-be0c-ba814bac48b6-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "cinder-287ba264-e6f6-4cd2-b31b-1c07f811f5ca-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-287ba264-e6f6-4cd2-b31b-1c07f811f5ca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "cinder-quobyte-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-quobyte-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d306d07-4a08-43d9-88a1-9f8bb6f42ebc]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:57 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca Apr 10 16:17:57 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:57 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037" returned: 0 in 0.537s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1281992804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9739e715b5f42d18b05687117f8de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:17:57Z,use_quota=True,user_id='a4069bf525cd423caaa74f16396a9535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Creating volume bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:17:57 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:17:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d80e972-919d-40a1-b40a-80b63a0d1e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01495294-2313-48c3-855b-2ae47a7d0037', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1719b9e4-a1e9-498c-8a39-48c2b2d8b969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:58 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Volume volume-01495294-2313-48c3-855b-2ae47a7d0037 (01495294-2313-48c3-855b-2ae47a7d0037): created successfully Apr 10 16:17:58 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 1073741824 Apr 10 16:17:58 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1719b9e4-a1e9-498c-8a39-48c2b2d8b969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Flow 'volume_create_manager' (ba9fbe52-7f54-41fc-8731-4cff11b21b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:58 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-000f0ec1-13bc-405a-9893-35801b28c2e1 tempest-ServersNegativeTestJSON-1053881294 None] Created volume successfully. Apr 10 16:17:58 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" returned: 0 in 0.760s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:58 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca Apr 10 16:17:58 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:58 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 1073741824" returned: 0 in 0.710s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:58 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 Apr 10 16:17:58 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:59 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" returned: 0 in 0.632s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-quobyte-287ba264-e6f6-4cd2-b31b-1c07f811f5ca" released by "delete_volume" :: held 1.427s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.quota [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Created reservations ['170dd6cd-bccd-47a0-ab2c-d8e009f6a2ad', '8e96c879-1afc-466d-9798-4f68dca586c9', '54e8b4ad-5235-4e1d-8acc-0a1357317921', '480ee705-8770-41b7-9b04-09aef1fe7f2e'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:17:59 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:17:59 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:17:59 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1" returned: 0 in 0.734s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676ff36e-308d-4e17-a3fd-a6ab0d39c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3d7749-86dc-45c5-b63a-6fe9d9bc8c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:17:59 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Volume volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 (bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1): created successfully Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3d7749-86dc-45c5-b63a-6fe9d9bc8c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:17:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Flow 'volume_create_manager' (0a7be687-6025-4538-9728-d947d81c836b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:17:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-54e3bc92-8b80-4117-8f8e-846616d362c4 tempest-VolumesListAdminTestJSON-1574522681 None] Created volume successfully. Apr 10 16:18:00 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.809s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.manager [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:00 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Deleted volume successfully. Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-6a29c371-bae3-4e68-8b1e-1cc1c881c8ed req-d8cc604c-c6e7-45dd-8eff-4e5165f67258 tempest-ServerBootFromVolumeStableRescueTest-1972625117 None] Lock "cinder-287ba264-e6f6-4cd2-b31b-1c07f811f5ca-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Flow 'volume_create_manager' (1c89e3e9-6ed6-4c9a-aafe-8e3929bfee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c62bfa9-dd63-4d9f-bbec-9ed1e004ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c62bfa9-dd63-4d9f-bbec-9ed1e004ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1108856401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f024ba-3f6c-479a-9098-81fd20c826c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e225753bf27641e4abbd7a1b3e0bcad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:00Z,use_quota=True,user_id='75e029a579c44945a8e05e5bebf5df1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b673b89e-6ad4-42a8-a1a8-e7996465f11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b673b89e-6ad4-42a8-a1a8-e7996465f11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3942a53f-a5ce-4045-9209-0ad29709a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3942a53f-a5ce-4045-9209-0ad29709a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f024ba-3f6c-479a-9098-81fd20c826c5', 'volume_name': 'volume-86f024ba-3f6c-479a-9098-81fd20c826c5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c91fdf9-64a0-448e-9e99-6c3eb73ced9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c91fdf9-64a0-448e-9e99-6c3eb73ced9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdda7cbf-99c4-4a0b-9d8e-7d2e799a395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Volume 86f024ba-3f6c-479a-9098-81fd20c826c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f024ba-3f6c-479a-9098-81fd20c826c5', 'volume_size': 1} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1108856401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f024ba-3f6c-479a-9098-81fd20c826c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e225753bf27641e4abbd7a1b3e0bcad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:00Z,use_quota=True,user_id='75e029a579c44945a8e05e5bebf5df1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Creating volume 86f024ba-3f6c-479a-9098-81fd20c826c5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:00 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:00 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 1073741824 Apr 10 16:18:00 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Flow 'volume_create_manager' (9d94ffa3-fcc6-4ac4-a0c2-4c4efc84419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8941f01-1cbf-4c0a-bee0-ff8580ca8eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8941f01-1cbf-4c0a-bee0-ff8580ca8eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172731bd-364f-48eb-8276-016691df26c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b016d2a5349d408da194afab0e1b4736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:00Z,use_quota=True,user_id='5c5cfb0cd3de4a208830db4ced151351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb4e9d9-e651-4c89-aa14-8de14ed4b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb4e9d9-e651-4c89-aa14-8de14ed4b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b03031-9c68-494c-bb82-faf9548af01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b03031-9c68-494c-bb82-faf9548af01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172731bd-364f-48eb-8276-016691df26c5', 'volume_name': 'volume-172731bd-364f-48eb-8276-016691df26c5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96012f04-9821-4abb-8762-1d8eb576459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96012f04-9821-4abb-8762-1d8eb576459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c101906d-77fd-495d-a2f9-5643f3e929b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:00 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Volume 172731bd-364f-48eb-8276-016691df26c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172731bd-364f-48eb-8276-016691df26c5', 'volume_size': 1} Apr 10 16:18:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:01 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 1073741824" returned: 0 in 0.869s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:01 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 Apr 10 16:18:01 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:01 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172731bd-364f-48eb-8276-016691df26c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b016d2a5349d408da194afab0e1b4736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:00Z,use_quota=True,user_id='5c5cfb0cd3de4a208830db4ced151351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Creating volume 172731bd-364f-48eb-8276-016691df26c5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:01 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdda7cbf-99c4-4a0b-9d8e-7d2e799a395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f024ba-3f6c-479a-9098-81fd20c826c5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414b95fb-80b4-4cbf-b2c3-418b65bb1815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:01 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Volume volume-86f024ba-3f6c-479a-9098-81fd20c826c5 (86f024ba-3f6c-479a-9098-81fd20c826c5): created successfully Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414b95fb-80b4-4cbf-b2c3-418b65bb1815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:01 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 1073741824 Apr 10 16:18:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Flow 'volume_create_manager' (1c89e3e9-6ed6-4c9a-aafe-8e3929bfee09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:01 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:01 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-13ddace9-c2ba-4cb6-8673-310c2360410f tempest-ServersNegativeTestJSON-1053881294 None] Created volume successfully. Apr 10 16:18:02 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 1073741824" returned: 0 in 0.726s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:02 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 Apr 10 16:18:02 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:02 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "cinder-86f024ba-3f6c-479a-9098-81fd20c826c5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:02 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-86f024ba-3f6c-479a-9098-81fd20c826c5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:02 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "cinder-quobyte-86f024ba-3f6c-479a-9098-81fd20c826c5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:02 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-quobyte-86f024ba-3f6c-479a-9098-81fd20c826c5" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cec70b8-d2bc-4971-b911-91d3fb6f7a22]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:03 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 Apr 10 16:18:03 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:03 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5" returned: 0 in 0.779s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c101906d-77fd-495d-a2f9-5643f3e929b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172731bd-364f-48eb-8276-016691df26c5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5fc627-8476-4df7-b9cc-4693c8537f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:03 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Volume volume-172731bd-364f-48eb-8276-016691df26c5 (172731bd-364f-48eb-8276-016691df26c5): created successfully Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5fc627-8476-4df7-b9cc-4693c8537f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Flow 'volume_create_manager' (9d94ffa3-fcc6-4ac4-a0c2-4c4efc84419a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2f8240e9-3caa-4b68-a418-2a61fc81c677 tempest-VolumesListAdminTestJSON-1559643261 None] Created volume successfully. Apr 10 16:18:03 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5" returned: 0 in 0.779s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:03 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5 Apr 10 16:18:03 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Acquiring lock "cinder-172731bd-364f-48eb-8276-016691df26c5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Lock "cinder-172731bd-364f-48eb-8276-016691df26c5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Acquiring lock "cinder-quobyte-172731bd-364f-48eb-8276-016691df26c5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Lock "cinder-quobyte-172731bd-364f-48eb-8276-016691df26c5" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ed70a-f61a-423c-9c88-b72d51e5dccd]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:04 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 Apr 10 16:18:04 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "cinder-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "cinder-quobyte-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-quobyte-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1" acquired by "delete_volume" :: waited 0.022s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3488a0e7-fd3c-40ed-a838-c29a923f4358]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:04 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 Apr 10 16:18:04 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:04 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86f024ba-3f6c-479a-9098-81fd20c826c5" returned: 0 in 0.678s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-quobyte-86f024ba-3f6c-479a-9098-81fd20c826c5" released by "delete_volume" :: held 1.492s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Created reservations ['9bd0724f-33ff-48f1-84ce-0d8b58af1610', '9b097636-ab10-4378-8abe-118443a4bd1e', 'a4c0f19a-42da-4d2e-b070-bc74da0b4cfd', 'e094a5cc-4d8a-4750-9546-4ae396b81ae7'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:04 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:04 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "cinder-01495294-2313-48c3-855b-2ae47a7d0037-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-01495294-2313-48c3-855b-2ae47a7d0037-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "cinder-quobyte-01495294-2313-48c3-855b-2ae47a7d0037" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:05 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5" returned: 0 in 1.408s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:05 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1" returned: 0 in 1.169s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:05 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5 Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-quobyte-01495294-2313-48c3-855b-2ae47a7d0037" acquired by "delete_volume" :: waited 0.068s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:05 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a8905-b0ab-4f2c-8cb9-80b0c90de90c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:05 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1 Apr 10 16:18:05 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:05 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.974s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Deleted volume successfully. Apr 10 16:18:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8cea1ed-7dd8-42f2-b16d-8a39441977af tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-86f024ba-3f6c-479a-9098-81fd20c826c5-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:05 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 Apr 10 16:18:05 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:06 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-172731bd-364f-48eb-8276-016691df26c5" returned: 0 in 0.845s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Lock "cinder-quobyte-172731bd-364f-48eb-8276-016691df26c5" released by "delete_volume" :: held 2.285s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Created reservations ['b5a81087-8d5b-478f-acdb-ef4f7d23a127', '44f8681e-ea5d-4dfa-b97f-1da22087e455', '5f4c639a-493c-4c6e-bf02-0e0c73d981be', '3b95f40e-409f-4ddb-a3c0-14e74bf1d757'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:06 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1" returned: 0 in 0.975s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-quobyte-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1" released by "delete_volume" :: held 2.200s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:06 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:06 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:06 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037" returned: 0 in 1.007s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Created reservations ['97ea72c3-7303-48fb-87f2-f3feb868356e', '869f8bfe-b5ad-4f4a-acfd-b75d0eafb19b', '25170139-69bb-41cb-b7d6-e478bd4da6e9', 'c7ab315f-cf14-4267-8c02-3d4664d88fc3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:06 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037 Apr 10 16:18:06 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:06 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:06 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:06 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.480s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Deleted volume successfully. Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09fec988-a494-4378-8f19-029d03fc08ed tempest-VolumesListAdminTestJSON-1559643261 None] Lock "cinder-172731bd-364f-48eb-8276-016691df26c5-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:06 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01495294-2313-48c3-855b-2ae47a7d0037" returned: 0 in 0.542s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-quobyte-01495294-2313-48c3-855b-2ae47a7d0037" released by "delete_volume" :: held 1.591s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Created reservations ['35345431-7e1f-4196-a5a3-5a383d488a93', 'ddb38d3c-6505-443b-a59c-d6224d021b44', 'b7f7f5b2-53a2-4670-8d2f-f847a3c48a25', 'ae32a26e-8c44-4853-a5b5-09db89c64100'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:07 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.539s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:07 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Deleted volume successfully. Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a06dcb-e353-4bef-b2f0-6ee84986dfcc tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-bb7d5d56-546e-4b30-b4c6-1445ebf1d5a1-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:07 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:07 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "cinder-10efc942-25c5-44de-97bd-04c381e690b6-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-10efc942-25c5-44de-97bd-04c381e690b6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "cinder-quobyte-10efc942-25c5-44de-97bd-04c381e690b6" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-quobyte-10efc942-25c5-44de-97bd-04c381e690b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a8cfcb-05c4-4b09-b4d9-4c4f3e986247]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:07 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.600s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:07 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Deleted volume successfully. Apr 10 16:18:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-97d6a288-eb19-4075-93a7-64e90c382af4 tempest-ServersNegativeTestJSON-1053881294 None] Lock "cinder-01495294-2313-48c3-855b-2ae47a7d0037-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:07 devstack sudo[86316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 Apr 10 16:18:07 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:08 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6" returned: 0 in 0.690s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:08 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6 Apr 10 16:18:08 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:08 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10efc942-25c5-44de-97bd-04c381e690b6" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-quobyte-10efc942-25c5-44de-97bd-04c381e690b6" released by "delete_volume" :: held 1.213s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Created reservations ['56ecf79e-4222-498a-b0d5-8aca3e496af7', '6a0b09ad-1e1f-4b27-9aa8-7d8ff0004f8b', 'a013c677-d2c5-47d1-8adb-37af961ba710', 'ae2f69a8-fea7-4466-82b0-056989d97cf0'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:08 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:08 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:09 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.503s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Deleted volume successfully. Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bb28454-301d-4fa0-840b-66fd3a871d9e tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-10efc942-25c5-44de-97bd-04c381e690b6-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "cinder-01dee715-7471-4b59-b081-edf2693e97d9-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-01dee715-7471-4b59-b081-edf2693e97d9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "cinder-quobyte-01dee715-7471-4b59-b081-edf2693e97d9" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-quobyte-01dee715-7471-4b59-b081-edf2693e97d9" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a50b2-264d-49cc-82e3-25d54d786f3a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:09 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 Apr 10 16:18:09 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:10 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9" returned: 0 in 0.594s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:10 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9 Apr 10 16:18:10 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:11 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-01dee715-7471-4b59-b081-edf2693e97d9" returned: 0 in 0.681s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-quobyte-01dee715-7471-4b59-b081-edf2693e97d9" released by "delete_volume" :: held 1.301s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Created reservations ['2b68b949-a7cb-47ae-8640-7585569dc99c', '67495264-ab51-411f-849a-1ddb7a0fa73d', 'e0fbbb72-cc2f-4960-8ac6-9e2b87bbff7f', 'a12cabaa-ca1d-46ec-99b1-a9721c9f97d2'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:11 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:11 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Flow 'volume_create_manager' (44765cbe-7191-4798-bc3c-67722d3202f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20454adb-7bd8-4e78-9c71-1f841f347592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20454adb-7bd8-4e78-9c71-1f841f347592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-290207307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f4573b-7ca4-4cd3-8ed4-3f5e174229be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16e88d00b17419094b7202385504e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:12Z,use_quota=True,user_id='6d5b0119ac374926942c17b275a5b021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a75593-ed87-4ffd-be49-b3bed965735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a75593-ed87-4ffd-be49-b3bed965735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7bbfa4-b397-48d9-95ff-ec5c66051697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7bbfa4-b397-48d9-95ff-ec5c66051697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f4573b-7ca4-4cd3-8ed4-3f5e174229be', 'volume_name': 'volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce682bac-e330-4c24-a829-499f2506ffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce682bac-e330-4c24-a829-499f2506ffbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eef722-ca9f-4eed-bcb3-4baa78edbcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:11 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Volume d4f4573b-7ca4-4cd3-8ed4-3f5e174229be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be', 'volume_size': 1} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-290207307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f4573b-7ca4-4cd3-8ed4-3f5e174229be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16e88d00b17419094b7202385504e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:12Z,use_quota=True,user_id='6d5b0119ac374926942c17b275a5b021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Creating volume d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:11 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:11 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be 1073741824 Apr 10 16:18:11 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:11 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.609s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Deleted volume successfully. Apr 10 16:18:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d1bbcf6f-46fd-4c8b-8b05-3a0f6a16b9db tempest-VolumesListAdminTestJSON-1574522681 None] Lock "cinder-01dee715-7471-4b59-b081-edf2693e97d9-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:12 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be 1073741824" returned: 0 in 0.596s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:12 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:18:12 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:12 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.507s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eef722-ca9f-4eed-bcb3-4baa78edbcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16463568-7eac-4c37-a63d-394bb3372094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:12 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Volume volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be (d4f4573b-7ca4-4cd3-8ed4-3f5e174229be): created successfully Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16463568-7eac-4c37-a63d-394bb3372094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Flow 'volume_create_manager' (44765cbe-7191-4798-bc3c-67722d3202f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c376177b-cd7d-44cf-84ec-8dbb2ea345c4 tempest-VolumesActionsTest-1745927240 None] Created volume successfully. Apr 10 16:18:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-377a307c-7458-4ea6-ae78-f86f72b2a480 tempest-BackendsCapabilitiesAdminTestsJSON-2015037920 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82117) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f3a28e55-1018-42fe-843c-889e2d62b7a0 tempest-BackendsCapabilitiesAdminTestsJSON-2015037920 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82117) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 16:18:15 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:15 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:15 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Flow 'volume_create_manager' (ac3a666c-9d93-4018-9eb8-8f693872c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae148998-af89-4291-92be-907c569c5695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae148998-af89-4291-92be-907c569c5695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-432214905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92eb94a2-d42a-47c7-bcb8-6248c463b65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cca57df79547379a2a00d1a035f9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:17Z,use_quota=True,user_id='06df899e2aa94fd5a2dc1036352ce1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f308b-68d2-4805-a54e-7752d5a4622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f308b-68d2-4805-a54e-7752d5a4622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88cb8fc-c4a3-42f1-b6a2-8628dadd815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88cb8fc-c4a3-42f1-b6a2-8628dadd815d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92eb94a2-d42a-47c7-bcb8-6248c463b65a', 'volume_name': 'volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef84759-55d7-4e55-93fe-b18a3388db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef84759-55d7-4e55-93fe-b18a3388db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68319c0e-0db6-4cca-ac16-00481c1b91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Volume 92eb94a2-d42a-47c7-bcb8-6248c463b65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a', 'volume_size': 1} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-432214905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92eb94a2-d42a-47c7-bcb8-6248c463b65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cca57df79547379a2a00d1a035f9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:17Z,use_quota=True,user_id='06df899e2aa94fd5a2dc1036352ce1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Creating volume 92eb94a2-d42a-47c7-bcb8-6248c463b65a {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:17 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:17 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a 1073741824 Apr 10 16:18:17 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:18 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a 1073741824" returned: 0 in 0.684s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:18 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a Apr 10 16:18:18 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:18 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a" returned: 0 in 0.615s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68319c0e-0db6-4cca-ac16-00481c1b91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84660fc6-2645-4990-943d-efcd90fcbef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:18 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Volume volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a (92eb94a2-d42a-47c7-bcb8-6248c463b65a): created successfully Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84660fc6-2645-4990-943d-efcd90fcbef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Flow 'volume_create_manager' (ac3a666c-9d93-4018-9eb8-8f693872c764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:18 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a8b03b7c-0581-4e68-8f1b-d6e4019f462b tempest-AbsoluteLimitsTests-1374519593 None] Created volume successfully. Apr 10 16:18:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Acquiring lock "cinder-92eb94a2-d42a-47c7-bcb8-6248c463b65a-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Lock "cinder-92eb94a2-d42a-47c7-bcb8-6248c463b65a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Acquiring lock "cinder-quobyte-92eb94a2-d42a-47c7-bcb8-6248c463b65a" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Lock "cinder-quobyte-92eb94a2-d42a-47c7-bcb8-6248c463b65a" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:19 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7d8603-7367-49bb-a251-e50bcdaa042f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:19 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a Apr 10 16:18:19 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b0fe91d4-7f75-4466-9e63-c28928d6350c tempest-GroupSnapshotsTest-364060987 None] Group tempest-GroupSnapshotsTest-Group-961912513: creating Apr 10 16:18:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b0fe91d4-7f75-4466-9e63-c28928d6350c tempest-GroupSnapshotsTest-364060987 None] Group tempest-GroupSnapshotsTest-Group-961912513: created successfully Apr 10 16:18:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b0fe91d4-7f75-4466-9e63-c28928d6350c tempest-GroupSnapshotsTest-364060987 None] Create group completed successfully. Apr 10 16:18:20 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a" returned: 0 in 0.665s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:20 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a Apr 10 16:18:20 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Flow 'volume_create_manager' (7713d960-9188-49ae-824b-5a27576c9821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d950594-215a-485b-abe2-6d95706567b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d950594-215a-485b-abe2-6d95706567b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1165270149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7959152c0be4138a6995af533268a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:20Z,use_quota=True,user_id='398c032b3f22453fa79269add640de9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd5b007-bcd0-4b7e-8f11-e5305f1e1e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd5b007-bcd0-4b7e-8f11-e5305f1e1e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d528432b-6cd8-4ffe-a29d-5bbf21f642e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d528432b-6cd8-4ffe-a29d-5bbf21f642e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1', 'volume_name': 'volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca78f3ed-3b80-4cf4-9a7e-0e6968ebcb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca78f3ed-3b80-4cf4-9a7e-0e6968ebcb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbe3452-7742-4247-80d9-42c354b85ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:20 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Volume fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1', 'volume_size': 1} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1165270149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7959152c0be4138a6995af533268a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:20Z,use_quota=True,user_id='398c032b3f22453fa79269add640de9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Creating volume fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:20 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:20 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 1073741824 Apr 10 16:18:20 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:20 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92eb94a2-d42a-47c7-bcb8-6248c463b65a" returned: 0 in 0.471s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Lock "cinder-quobyte-92eb94a2-d42a-47c7-bcb8-6248c463b65a" released by "delete_volume" :: held 1.189s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Created reservations ['2f1396cc-c325-460e-af91-944a923e8821', '371dcefe-faa3-4471-9b02-acc4e41843b0', '72dd9589-3e60-46b2-9e9a-cd768e66d03b', '3154a23f-73d0-43e2-b062-e6c00f9bcb49'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:20 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:20 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:21 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 1073741824" returned: 0 in 0.614s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (814c9a62-27c7-4072-b485-881e2e9bbb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b45666-db4f-408b-99c4-9080ee8dd837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b45666-db4f-408b-99c4-9080ee8dd837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1614194385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29f7f948-8079-4d17-b379-614ec0cfcc35,host='devstack@QuobyteHD#QuobyteHD',id=10182011-a6bc-4274-b857-86c111a8fb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:21Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d2865b7-0114-41bc-879e-211de3f77041),volume_type_id=7d2865b7-0114-41bc-879e-211de3f77041)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:21 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 Apr 10 16:18:21 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1531e27-5166-4809-982c-3848c424896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1531e27-5166-4809-982c-3848c424896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74171703-4ab5-4927-be72-0be43874650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74171703-4ab5-4927-be72-0be43874650b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10182011-a6bc-4274-b857-86c111a8fb67', 'volume_name': 'volume-10182011-a6bc-4274-b857-86c111a8fb67', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79a6d64-fd38-49e8-9d5a-c2a4b093120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79a6d64-fd38-49e8-9d5a-c2a4b093120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d92f900-975d-4f12-a78c-f1a2b4c2c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:21 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Volume 10182011-a6bc-4274-b857-86c111a8fb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10182011-a6bc-4274-b857-86c111a8fb67', 'volume_size': 1} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:21 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.548s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:21 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Deleted volume successfully. Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b4fcdbaa-dfa7-4308-bc5f-1e1c26421386 tempest-AbsoluteLimitsTests-1374519593 None] Lock "cinder-92eb94a2-d42a-47c7-bcb8-6248c463b65a-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:21 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" returned: 0 in 0.448s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29f7f948-8079-4d17-b379-614ec0cfcc35,created_at=2026-04-10T14:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1614194385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29f7f948-8079-4d17-b379-614ec0cfcc35,host='devstack@QuobyteHD#QuobyteHD',id=10182011-a6bc-4274-b857-86c111a8fb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:21Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d2865b7-0114-41bc-879e-211de3f77041),volume_type_id=7d2865b7-0114-41bc-879e-211de3f77041)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Creating volume 10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:21 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbe3452-7742-4247-80d9-42c354b85ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:21 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 1073741824 Apr 10 16:18:21 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21507b4a-6734-4aa5-8ac6-bc05fccbf0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:21 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Volume volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 (fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1): created successfully Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21507b4a-6734-4aa5-8ac6-bc05fccbf0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Flow 'volume_create_manager' (7713d960-9188-49ae-824b-5a27576c9821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:21 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-b87acfd4-fd05-43e0-a690-74139629a9ac req-2ac78a87-827b-4d66-89f6-20ba8f69783a tempest-VolumesSnapshotsTestJSON-325835549 None] Created volume successfully. Apr 10 16:18:22 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 1073741824" returned: 0 in 0.582s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:22 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:22 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:22 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.560s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.054s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Creating offline snapshot 13521c12-4ec0-4c83-b734-87cd42809985 of volume fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d92f900-975d-4f12-a78c-f1a2b4c2c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10182011-a6bc-4274-b857-86c111a8fb67', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd3017f-88e7-4ab3-9de0-6c0a0d05c271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f8d00-f177-49e8-b0c0-01ed33429606]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:22 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Volume volume-10182011-a6bc-4274-b857-86c111a8fb67 (10182011-a6bc-4274-b857-86c111a8fb67): created successfully Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd3017f-88e7-4ab3-9de0-6c0a0d05c271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (814c9a62-27c7-4072-b485-881e2e9bbb8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:23 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e04fb37b-d7ae-4cc8-999f-0a1129ab5793 tempest-GroupSnapshotsTest-364060987 None] Created volume successfully. Apr 10 16:18:23 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 Apr 10 16:18:23 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:23 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] GroupSnapshot 10d24c2d-d89a-4adb-aac5-a6f326d59016: creating. Apr 10 16:18:23 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:23 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Group snapshot 10d24c2d-d89a-4adb-aac5-a6f326d59016: creating. {{(pid=82117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 16:18:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" returned: 0 in 0.669s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:23 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 1G Apr 10 16:18:23 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:24 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 1G" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:24 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 Apr 10 16:18:24 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Flow 'volume_create_manager' (b48a2c8e-1bc8-471a-9cf7-0b0e13e62748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281f170f-8b04-4d90-b7ee-2740c230d804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281f170f-8b04-4d90-b7ee-2740c230d804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1777624862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b23a64-6972-42a3-b795-2c0806b93a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154affc77517467d95ea8c463d2dc35e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:24Z,use_quota=True,user_id='da02e0b6747f4cba9d98e5bf5faf03a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bb5e25-fe2f-4be5-b0ce-a2e84d235bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bb5e25-fe2f-4be5-b0ce-a2e84d235bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fb98f7-7124-4126-ae30-54f24ceab319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fb98f7-7124-4126-ae30-54f24ceab319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b23a64-6972-42a3-b795-2c0806b93a95', 'volume_name': 'volume-75b23a64-6972-42a3-b795-2c0806b93a95', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b697298e-4cd3-4221-9829-5cb6e5153e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b697298e-4cd3-4221-9829-5cb6e5153e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdd19b3-688a-4d13-b4ab-209e0912b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:24 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Volume 75b23a64-6972-42a3-b795-2c0806b93a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b23a64-6972-42a3-b795-2c0806b93a95', 'volume_size': 1} Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:24 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985" returned: 0 in 0.448s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:24 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 is being set with open permissions: ugo+rw Apr 10 16:18:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:24 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 Apr 10 16:18:24 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:25 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985" returned: 0 in 0.519s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:25 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info Apr 10 16:18:25 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:25 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:25 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info is being set with open permissions: ugo+rw Apr 10 16:18:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:25 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info Apr 10 16:18:25 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:26 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.info" returned: 0 in 0.449s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.551s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-a5b6a918-8bc4-4d23-b128-7aa9c1965f82 req-c2a8298d-2a8a-47cb-b22f-348fd126aaea tempest-VolumesSnapshotsTestJSON-325835549 None] Create snapshot completed successfully Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Creating offline snapshot 0d624b6d-a58b-44a8-a478-506cf6380fe8 of volume 10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[53379d2d-f47e-434c-b558-e66af73eea79]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:26 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:26 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "cinder-13521c12-4ec0-4c83-b734-87cd42809985-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-13521c12-4ec0-4c83-b734-87cd42809985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "cinder-quobyte-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-quobyte-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "cinder-quobyte-13521c12-4ec0-4c83-b734-87cd42809985" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-quobyte-13521c12-4ec0-4c83-b734-87cd42809985" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Deleting offline snapshot 13521c12-4ec0-4c83-b734-87cd42809985 of volume fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] snapshot_file for this snap is: volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de17412-e44a-4e06-a2e8-e6d8afdddb69]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:26 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 Apr 10 16:18:26 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:26 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.545s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:26 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 1G Apr 10 16:18:26 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:27 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985" returned: 0 in 0.498s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[23390380-0805-460d-93a3-3a2cfbac01aa]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:27 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 1G" returned: 0 in 0.525s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10182011-a6bc-4274-b857-86c111a8fb67 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:27 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 Apr 10 16:18:27 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:27 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10182011-a6bc-4274-b857-86c111a8fb67 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 Apr 10 16:18:27 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8f8ed5c-88c7-4d5a-b1d4-66ad5c40d915 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" by "attach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8f8ed5c-88c7-4d5a-b1d4-66ad5c40d915 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" acquired by "attach_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:27 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f8f8ed5c-88c7-4d5a-b1d4-66ad5c40d915 tempest-VolumesActionsTest-1745927240 None] Attaching volume d4f4573b-7ca4-4cd3-8ed4-3f5e174229be to instance bbd1e941-fb02-4f84-9860-ba3b6ff444e7 at mountpoint /dev/vdb on host None. Apr 10 16:18:27 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f8f8ed5c-88c7-4d5a-b1d4-66ad5c40d915 tempest-VolumesActionsTest-1745927240 None] Attach volume completed successfully. Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f8f8ed5c-88c7-4d5a-b1d4-66ad5c40d915 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" released by "attach_volume" :: held 0.071s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:27 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" returned: 0 in 0.604s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:27 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10182011-a6bc-4274-b857-86c111a8fb67 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:27 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:18:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:27 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 Apr 10 16:18:27 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:27 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 Apr 10 16:18:27 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-50abfa1c-89b5-4b3b-bb2a-795ffe53dea9 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-detach_volume" by "detach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-50abfa1c-89b5-4b3b-bb2a-795ffe53dea9 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:28 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-50abfa1c-89b5-4b3b-bb2a-795ffe53dea9 tempest-VolumesActionsTest-1745927240 None] Detaching volume d4f4573b-7ca4-4cd3-8ed4-3f5e174229be from instance bbd1e941-fb02-4f84-9860-ba3b6ff444e7. Apr 10 16:18:28 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-50abfa1c-89b5-4b3b-bb2a-795ffe53dea9 tempest-VolumesActionsTest-1745927240 None] Detach volume completed successfully. Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-50abfa1c-89b5-4b3b-bb2a-795ffe53dea9 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:28 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8" returned: 0 in 0.432s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:28 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info Apr 10 16:18:28 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:28 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:28 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985 Apr 10 16:18:28 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:28 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info" returned: 0 in 0.455s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:28 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:28 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info Apr 10 16:18:28 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:28 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1.13521c12-4ec0-4c83-b734-87cd42809985" returned: 0 in 0.521s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-quobyte-13521c12-4ec0-4c83-b734-87cd42809985" released by "_delete_snapshot" :: held 2.210s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-quobyte-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" released by "delete_snapshot" :: held 2.240s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.quota [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Created reservations ['ebbf469c-7c00-4a51-a632-4a0a5a944fbb', '49b2008b-6889-4704-8640-b546f4e636e8', '1d7d14a7-2001-45bf-b097-97a5ceb6523d', '5a93eff6-3860-426c-8834-12bfcce970e4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:28 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Delete snapshot completed successfully. Apr 10 16:18:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-a89cecfb-72ab-4248-ab2d-4fde9ef5635c req-1ffead3f-c4c8-4c26-b791-feee9815259d tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-13521c12-4ec0-4c83-b734-87cd42809985-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:29 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.info" returned: 0 in 0.466s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.623s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1777624862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b23a64-6972-42a3-b795-2c0806b93a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154affc77517467d95ea8c463d2dc35e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:24Z,use_quota=True,user_id='da02e0b6747f4cba9d98e5bf5faf03a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Creating volume 75b23a64-6972-42a3-b795-2c0806b93a95 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:29 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:29 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 1073741824 Apr 10 16:18:29 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c289b303-a568-4e42-a3dc-862d90df5387 tempest-GroupSnapshotsTest-364060987 None] group_snapshot 10d24c2d-d89a-4adb-aac5-a6f326d59016: created successfully Apr 10 16:18:29 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 1073741824" returned: 0 in 0.467s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:29 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 Apr 10 16:18:29 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "cinder-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "cinder-quobyte-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-quobyte-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b10642-807f-4161-8781-20c5a7efbbd0]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:30 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 Apr 10 16:18:30 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:30 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95" returned: 0 in 0.682s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdd19b3-688a-4d13-b4ab-209e0912b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b23a64-6972-42a3-b795-2c0806b93a95', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca47e6-fe25-4ff8-9c94-752f29091e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:30 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Volume volume-75b23a64-6972-42a3-b795-2c0806b93a95 (75b23a64-6972-42a3-b795-2c0806b93a95): created successfully Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca47e6-fe25-4ff8-9c94-752f29091e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Flow 'volume_create_manager' (b48a2c8e-1bc8-471a-9cf7-0b0e13e62748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:30 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e9ef7e13-9c4c-49fd-8880-56adba34437d tempest-VolumesMetadataTest-2045920328 None] Created volume successfully. Apr 10 16:18:30 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" returned: 0 in 0.538s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:30 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1 Apr 10 16:18:30 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-0d624b6d-a58b-44a8-a478-506cf6380fe8-a40d551d-33ce-4875-b52b-021bf0fa3062" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-0d624b6d-a58b-44a8-a478-506cf6380fe8-a40d551d-33ce-4875-b52b-021bf0fa3062" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Creating volume a40d551d-33ce-4875-b52b-021bf0fa3062 from snapshot 0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-a40d551d-33ce-4875-b52b-021bf0fa3062" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a40d551d-33ce-4875-b52b-021bf0fa3062" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] snapshot: 0d624b6d-a58b-44a8-a478-506cf6380fe8, volume: a40d551d-33ce-4875-b52b-021bf0fa3062, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed03a8b1-96ab-456e-8353-2ba6c2ac285e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:31 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 Apr 10 16:18:31 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:31 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" returned: 0 in 0.493s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-quobyte-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1" released by "delete_volume" :: held 1.074s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.quota [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Created reservations ['a5606192-1752-4a72-80e0-02a93f28f994', '2efb6c96-0f80-48ea-817c-f34c88f78e29', '91db8dda-b170-4852-b644-3aa49594f4e0', 'd5835fa5-d7cf-4b8f-8126-ec474d99acff'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:31 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:31 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:31 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8" returned: 0 in 0.686s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10182011-a6bc-4274-b857-86c111a8fb67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[058faad9-8925-4a35-999c-109430a394a1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Acquiring lock "cinder-75b23a64-6972-42a3-b795-2c0806b93a95-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Lock "cinder-75b23a64-6972-42a3-b795-2c0806b93a95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:31 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:31 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Acquiring lock "cinder-quobyte-75b23a64-6972-42a3-b795-2c0806b93a95" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Lock "cinder-quobyte-75b23a64-6972-42a3-b795-2c0806b93a95" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32098f-5c6b-4c55-9e09-199b96e2b4cc]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:31 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 Apr 10 16:18:31 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:31 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.524s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.manager [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:31 devstack cinder-volume[82117]: INFO cinder.volume.manager [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Deleted volume successfully. Apr 10 16:18:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [req-419ecc92-423d-4545-a619-7406b10afe06 req-77af58ab-d60f-4bd8-af23-e36929a0e402 tempest-VolumesSnapshotsTestJSON-325835549 None] Lock "cinder-fac4e9a8-e86a-4cb4-bd0e-331c2d8a41b1-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:32 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.521s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:32 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:18:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:32 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 Apr 10 16:18:32 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:32 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95" returned: 0 in 0.534s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:32 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95 Apr 10 16:18:32 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:32 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-75b23a64-6972-42a3-b795-2c0806b93a95" returned: 0 in 0.728s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Lock "cinder-quobyte-75b23a64-6972-42a3-b795-2c0806b93a95" released by "delete_volume" :: held 1.303s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Created reservations ['c959037c-3569-44a7-ae4b-92e614844858', '948843a6-6a07-4ab5-b636-7ea57ca5e30c', '6ba60147-a583-46a2-b32f-84184f39e956', 'cad53a23-a5e3-4b24-95cb-12e29f66633f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:33 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:33 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:34 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.360s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:34 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Deleted volume successfully. Apr 10 16:18:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1967da16-8c51-4586-a663-23c557f1c6ca tempest-VolumesMetadataTest-2045920328 None] Lock "cinder-75b23a64-6972-42a3-b795-2c0806b93a95-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:34 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062" returned: 0 in 2.588s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:34 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187255e-cb9d-40d2-89ff-fe06c9e350b1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:34 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:34 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:35 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.756s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:35 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:18:35 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Converted 1024.00 MB image at 395.47 MB/s Apr 10 16:18:35 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:18:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:35 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 Apr 10 16:18:35 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:36 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062" returned: 0 in 0.551s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a40d551d-33ce-4875-b52b-021bf0fa3062" released by "_copy_volume_from_snapshot" :: held 5.161s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-0d624b6d-a58b-44a8-a478-506cf6380fe8-a40d551d-33ce-4875-b52b-021bf0fa3062" released by "_create_volume_from_snapshot" :: held 5.178s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.188s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5c4e4847-d4be-49db-a6cb-2bcbc743cd29 tempest-GroupSnapshotsTest-364060987 None] Create group from source-snapshot-10d24c2d-d89a-4adb-aac5-a6f326d59016 completed successfully. Apr 10 16:18:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0bcaebc0-b76c-48a7-99dd-ac0d95fc6195 tempest-GroupsV320Test-372235664 None] Group tempest-GroupsV320Test-Group-221340409: creating Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Flow 'volume_create_manager' (098efd05-1409-41a4-9529-02e2060f3216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c06cc6b-8c9e-42e0-97fd-e51f0b84b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0bcaebc0-b76c-48a7-99dd-ac0d95fc6195 tempest-GroupsV320Test-372235664 None] Group tempest-GroupsV320Test-Group-221340409: created successfully Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c06cc6b-8c9e-42e0-97fd-e51f0b84b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1915975321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc7d9c858484a23a712b2060a31f227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:36Z,use_quota=True,user_id='61a81e7c5baa4267acbdfec3d83552fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a773676-fc1b-4bd7-82ca-76bdef8bf842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a773676-fc1b-4bd7-82ca-76bdef8bf842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e5f51a-df63-4c3b-93ae-ad9a17e08dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e5f51a-df63-4c3b-93ae-ad9a17e08dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905', 'volume_name': 'volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905', 'volume_size': 2}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d724641-76a6-4def-8567-b3f9744630cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d724641-76a6-4def-8567-b3f9744630cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711bc9c8-b633-4caa-b49f-34c910044cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:36 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Volume 2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905', 'volume_size': 2} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1915975321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc7d9c858484a23a712b2060a31f227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:36Z,use_quota=True,user_id='61a81e7c5baa4267acbdfec3d83552fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Creating volume 2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:36 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 2147483648 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0bcaebc0-b76c-48a7-99dd-ac0d95fc6195 tempest-GroupsV320Test-372235664 None] Create group completed successfully. Apr 10 16:18:36 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 2147483648 Apr 10 16:18:36 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-a40d551d-33ce-4875-b52b-021bf0fa3062" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a40d551d-33ce-4875-b52b-021bf0fa3062" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e78b9db-6795-4743-a7a7-9eb6ac287021]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:37 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 Apr 10 16:18:37 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:37 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 2147483648" returned: 0 in 0.595s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:37 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 Apr 10 16:18:37 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:37 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062" returned: 0 in 0.505s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:37 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062 Apr 10 16:18:37 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:37 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905" returned: 0 in 0.448s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711bc9c8-b633-4caa-b49f-34c910044cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905', 'volume_size': 2}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0376a3-37fd-49e9-a4ca-465a2e8913b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:37 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Volume volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 (2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905): created successfully Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0376a3-37fd-49e9-a4ca-465a2e8913b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Flow 'volume_create_manager' (098efd05-1409-41a4-9529-02e2060f3216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0164ff54-d960-4468-9f8e-44036c9cc379 tempest-VolumesCloneNegativeTest-221279699 None] Created volume successfully. Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Created reservations ['8093ec7d-9555-40d4-9607-6f169e0add25'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:37 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a40d551d-33ce-4875-b52b-021bf0fa3062" returned: 0 in 0.495s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:37 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:37 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a40d551d-33ce-4875-b52b-021bf0fa3062" released by "delete_volume" :: held 1.023s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:37 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Created reservations ['b4681936-f61b-4877-a3ff-11797295bd7d'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:38 devstack cinder-volume[82117]: WARNING cinder.quota [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-10288884 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-10288884, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:18:38 devstack cinder-volume[82117]: WARNING cinder.quota [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-10288884 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-10288884, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Created reservations ['854790e7-d908-4883-b4a9-99ee1cf8fa9a', '829c8232-67ac-4bb8-a855-cbe0046c8ceb', 'a8748a49-41ef-475c-87f0-7a579bac5087', '4eb1a882-d54b-497c-82fd-5aa32740b9f6'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:38 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:38 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:38 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.431s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-972e0e50-f11d-486c-9166-7ba9267fe893 tempest-GroupsV320Test-372235664 None] Delete group completed successfully. Apr 10 16:18:38 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.408s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3e23b089-ad45-48a1-a2a2-14e7f21abbe7 tempest-GroupSnapshotsTest-364060987 None] Delete group completed successfully. Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Acquiring lock "cinder-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Lock "cinder-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Acquiring lock "cinder-quobyte-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Lock "cinder-quobyte-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb70a69-b15b-4318-960c-447a638b0266]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:38 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 Apr 10 16:18:38 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:39 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] group_snapshot 10d24c2d-d89a-4adb-aac5-a6f326d59016: deleting Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] group_snapshot 10d24c2d-d89a-4adb-aac5-a6f326d59016: deleting {{(pid=82117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-10182011-a6bc-4274-b857-86c111a8fb67" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-10182011-a6bc-4274-b857-86c111a8fb67" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-0d624b6d-a58b-44a8-a478-506cf6380fe8" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-0d624b6d-a58b-44a8-a478-506cf6380fe8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Deleting offline snapshot 0d624b6d-a58b-44a8-a478-506cf6380fe8 of volume 10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] snapshot_file for this snap is: volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[77279f56-d5ae-4905-b797-81f80c7dc224]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:39 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 Apr 10 16:18:39 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:39 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905" returned: 0 in 0.599s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:39 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905 Apr 10 16:18:39 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:39 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8" returned: 0 in 0.516s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10182011-a6bc-4274-b857-86c111a8fb67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[710591f1-4922-4ff2-9ee3-bda8b46f9e39]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:39 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905" returned: 0 in 0.497s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:39 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Lock "cinder-quobyte-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905" released by "delete_volume" :: held 1.122s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:39 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Created reservations ['2e3fa37f-776f-422a-b74a-9cd08f7784a6', '7b0702bf-5752-4d7d-9ac5-065b1ba1ad6f', 'cfdc82bb-bc12-47ee-b582-9dc3d829c540', '4c12187a-12b2-4f2b-b056-03107a6b46a4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:39 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:39 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:40 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.562s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:40 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 Apr 10 16:18:40 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:40 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.524s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Deleted volume successfully. Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-43beddc6-d3d0-4bf5-85be-8cf5cdccd3bb tempest-VolumesCloneNegativeTest-221279699 None] Lock "cinder-2df967d7-67c3-4d4b-9fb0-7ca8e5fa9905-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:40 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8" returned: 0 in 0.654s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:41 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8 Apr 10 16:18:41 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:41 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67.0d624b6d-a58b-44a8-a478-506cf6380fe8" returned: 0 in 0.629s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-0d624b6d-a58b-44a8-a478-506cf6380fe8" released by "_delete_snapshot" :: held 2.423s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-10182011-a6bc-4274-b857-86c111a8fb67" released by "delete_snapshot" :: held 2.443s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:41 devstack cinder-volume[82117]: WARNING cinder.quota [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-10288884 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-10288884, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:18:41 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] Created reservations ['60d49989-6b45-4ff0-b8d5-171a1b3da683', '38e8c9c3-9e68-44a3-99ac-483c70097227', '7dcf3b8c-c340-4d6b-8c02-00caa60dbbfe', '4d269617-db3d-4527-bec9-fac49221555d'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-57877f8f-7a17-4a51-92da-a5e1aa352a0c tempest-GroupSnapshotsTest-364060987 None] group_snapshot 10d24c2d-d89a-4adb-aac5-a6f326d59016: deleted successfully Apr 10 16:18:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-10182011-a6bc-4274-b857-86c111a8fb67" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-10182011-a6bc-4274-b857-86c111a8fb67" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dce215-e03f-4257-92d2-b7ac93ec84be]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:42 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:42 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:43 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.627s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:43 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67 Apr 10 16:18:43 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Flow 'volume_create_manager' (9dce901a-355f-4690-a6ef-6e8b330d2adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd5603c-b1aa-446b-8716-cd2e2dfc4c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd5603c-b1aa-446b-8716-cd2e2dfc4c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170544115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e371e0d3-d4b7-4eef-a68a-6eb47e294237,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0d86cc17e546909aaf35eec2e10849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:43Z,use_quota=True,user_id='ccec968eb5f748bbb8936eba53f62b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498a4eed-1245-400d-a7cb-c029c720f17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498a4eed-1245-400d-a7cb-c029c720f17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46646ef-8ec7-4fb8-bf86-94e9cd70b18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46646ef-8ec7-4fb8-bf86-94e9cd70b18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e371e0d3-d4b7-4eef-a68a-6eb47e294237', 'volume_name': 'volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b35035-c842-4ab6-8dc8-5f9f84a50f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b35035-c842-4ab6-8dc8-5f9f84a50f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9693a816-ba75-4339-9aa9-2862dd30524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:43 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Volume e371e0d3-d4b7-4eef-a68a-6eb47e294237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237', 'volume_size': 1} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170544115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e371e0d3-d4b7-4eef-a68a-6eb47e294237,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0d86cc17e546909aaf35eec2e10849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:43Z,use_quota=True,user_id='ccec968eb5f748bbb8936eba53f62b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Creating volume e371e0d3-d4b7-4eef-a68a-6eb47e294237 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:43 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:43 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 1073741824 Apr 10 16:18:43 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:43 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10182011-a6bc-4274-b857-86c111a8fb67" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-10182011-a6bc-4274-b857-86c111a8fb67" released by "delete_volume" :: held 1.193s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Created reservations ['0ca8f82e-c1b0-4f5b-8781-f5987e1f99d8'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:43 devstack cinder-volume[82117]: WARNING cinder.db.sqlalchemy.api [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-10288884'] Apr 10 16:18:43 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Created reservations ['818519e3-06c4-4a27-aff4-8a4658c2ca60', '84e5112f-f475-439e-9b5b-a237ec12f02a', '706a0a8d-68f5-4f31-b82d-39a07af1781b', '3e1f185c-eff2-4983-9c4c-01c222c7eb5b'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:44 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:44 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:44 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 1073741824" returned: 0 in 0.681s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:44 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 Apr 10 16:18:44 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:44 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.491s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9a957d09-f05c-442a-bb1b-d105edad71e8 tempest-GroupSnapshotsTest-364060987 None] Delete group completed successfully. Apr 10 16:18:44 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237" returned: 0 in 0.525s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9693a816-ba75-4339-9aa9-2862dd30524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f2bc07-482c-469c-aff5-1464a0f50f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:44 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Volume volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 (e371e0d3-d4b7-4eef-a68a-6eb47e294237): created successfully Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f2bc07-482c-469c-aff5-1464a0f50f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Flow 'volume_create_manager' (9dce901a-355f-4690-a6ef-6e8b330d2adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0f0ec0ef-7df3-4a91-a7fc-07f20dd95c08 tempest-VolumesListTestJSON-378093126 None] Created volume successfully. Apr 10 16:18:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-12a8bc75-7936-47a3-bb4c-d8f5d33bc609 tempest-GroupSnapshotsTest-364060987 None] Group tempest-GroupSnapshotsTest-Group-1183132154: creating Apr 10 16:18:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-12a8bc75-7936-47a3-bb4c-d8f5d33bc609 tempest-GroupSnapshotsTest-364060987 None] Group tempest-GroupSnapshotsTest-Group-1183132154: created successfully Apr 10 16:18:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-12a8bc75-7936-47a3-bb4c-d8f5d33bc609 tempest-GroupSnapshotsTest-364060987 None] Create group completed successfully. Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Flow 'volume_create_manager' (57ff104e-52f9-44f6-b974-1e5d07d339d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b924749-3f3c-40c7-93a6-507027b8829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b924749-3f3c-40c7-93a6-507027b8829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2040349705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce138d76-d88c-4008-8c09-fa5498aaf7ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0d86cc17e546909aaf35eec2e10849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:46Z,use_quota=True,user_id='ccec968eb5f748bbb8936eba53f62b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd620928-0123-429b-8fb4-706db7e6ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd620928-0123-429b-8fb4-706db7e6ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b955950-8d1a-4d0a-96ca-f7194732d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b955950-8d1a-4d0a-96ca-f7194732d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce138d76-d88c-4008-8c09-fa5498aaf7ba', 'volume_name': 'volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58a73ba-546a-4f73-bb52-045526f24bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58a73ba-546a-4f73-bb52-045526f24bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8818c3fb-75fa-44d3-8818-fbf970b004ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Volume ce138d76-d88c-4008-8c09-fa5498aaf7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba', 'volume_size': 1} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2040349705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce138d76-d88c-4008-8c09-fa5498aaf7ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0d86cc17e546909aaf35eec2e10849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:46Z,use_quota=True,user_id='ccec968eb5f748bbb8936eba53f62b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Creating volume ce138d76-d88c-4008-8c09-fa5498aaf7ba {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:46 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:46 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba 1073741824 Apr 10 16:18:46 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (2dca30f0-d7f8-4dd3-bd46-64c3e9e73379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7f4902-6543-4c86-86dd-a3d30378e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7f4902-6543-4c86-86dd-a3d30378e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892615269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee7f693-75ef-4422-9b4a-c9a4752528e2,host='devstack@QuobyteHD#QuobyteHD',id=136b237a-aad0-4230-a7d7-c515fc9e9f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:47Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbab9b82-1773-4341-a7b9-0be81a44fa38),volume_type_id=dbab9b82-1773-4341-a7b9-0be81a44fa38)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58180277-ce64-4ff9-956a-9730614cd7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58180277-ce64-4ff9-956a-9730614cd7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fc38ca-85fe-4ab2-84dd-60f6e009768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fc38ca-85fe-4ab2-84dd-60f6e009768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136b237a-aad0-4230-a7d7-c515fc9e9f73', 'volume_name': 'volume-136b237a-aad0-4230-a7d7-c515fc9e9f73', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930d16d-2488-4ba5-b811-ed898335ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930d16d-2488-4ba5-b811-ed898335ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d91d43-88fb-4df1-8b61-282a26364b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:46 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Volume 136b237a-aad0-4230-a7d7-c515fc9e9f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136b237a-aad0-4230-a7d7-c515fc9e9f73', 'volume_size': 1} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:46 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba 1073741824" returned: 0 in 0.670s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:46 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba Apr 10 16:18:46 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:47 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba" returned: 0 in 0.613s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ee7f693-75ef-4422-9b4a-c9a4752528e2,created_at=2026-04-10T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892615269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee7f693-75ef-4422-9b4a-c9a4752528e2,host='devstack@QuobyteHD#QuobyteHD',id=136b237a-aad0-4230-a7d7-c515fc9e9f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:47Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbab9b82-1773-4341-a7b9-0be81a44fa38),volume_type_id=dbab9b82-1773-4341-a7b9-0be81a44fa38)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Creating volume 136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:47 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8818c3fb-75fa-44d3-8818-fbf970b004ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:47 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 1073741824 Apr 10 16:18:47 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7880ac40-47b5-4882-a50a-ac5feedd1a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:47 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Volume volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba (ce138d76-d88c-4008-8c09-fa5498aaf7ba): created successfully Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7880ac40-47b5-4882-a50a-ac5feedd1a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Flow 'volume_create_manager' (57ff104e-52f9-44f6-b974-1e5d07d339d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:47 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-04beab7a-f100-47f0-8ab5-b30c2cb17ff4 tempest-VolumesListTestJSON-378093126 None] Created volume successfully. Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Flow 'volume_create_manager' (e34ce8ee-052c-419b-ab72-9b80343ca815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1b0ac1-26a5-401c-993a-a64275dae930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1b0ac1-26a5-401c-993a-a64275dae930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1221368363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b6f335-06ae-4c73-835c-a8e1088f44b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cec8c7d1a1844aabb68f4b8454d4476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:48Z,use_quota=True,user_id='afa6f6df8d2243fd978a3d9cc7803d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42a0d4f-d242-4fcf-8d9e-c50453a0db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42a0d4f-d242-4fcf-8d9e-c50453a0db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf78650e-5b22-4a90-a4b3-7419ba540f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf78650e-5b22-4a90-a4b3-7419ba540f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b6f335-06ae-4c73-835c-a8e1088f44b5', 'volume_name': 'volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4f188f-d9f7-4725-8a51-56eaec835bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4f188f-d9f7-4725-8a51-56eaec835bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8642ec6e-f8e8-4b20-9469-bba2659e0c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:47 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Volume b3b6f335-06ae-4c73-835c-a8e1088f44b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5', 'volume_size': 1} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:47 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 1073741824" returned: 0 in 0.605s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:48 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 Apr 10 16:18:48 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Flow 'volume_create_manager' (71f6511e-05f4-47e8-b6ca-6c4e9931fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ef9ffd-33a9-4dcd-a9e2-2bbb85b5e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ef9ffd-33a9-4dcd-a9e2-2bbb85b5e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2039993895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bbf4d8-8815-41d0-9e46-68abe5fcdd13,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0d86cc17e546909aaf35eec2e10849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:48Z,use_quota=True,user_id='ccec968eb5f748bbb8936eba53f62b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4929449b-1021-4ffd-bb0a-00eb61b7275f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4929449b-1021-4ffd-bb0a-00eb61b7275f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffa7416-3f5a-4912-a9cd-04a50d469787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffa7416-3f5a-4912-a9cd-04a50d469787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bbf4d8-8815-41d0-9e46-68abe5fcdd13', 'volume_name': 'volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df0337e-fa7e-489b-96cb-4f4215e7e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df0337e-fa7e-489b-96cb-4f4215e7e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f7403c-aebe-452d-819f-f24348878996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:48 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Volume 92bbf4d8-8815-41d0-9e46-68abe5fcdd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13', 'volume_size': 1} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:48 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73" returned: 0 in 0.550s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1221368363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b6f335-06ae-4c73-835c-a8e1088f44b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cec8c7d1a1844aabb68f4b8454d4476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:48Z,use_quota=True,user_id='afa6f6df8d2243fd978a3d9cc7803d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Creating volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:48 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d91d43-88fb-4df1-8b61-282a26364b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136b237a-aad0-4230-a7d7-c515fc9e9f73', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:48 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 1073741824 Apr 10 16:18:48 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45eaacf9-344b-456e-9962-fd365911c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:48 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Volume volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 (136b237a-aad0-4230-a7d7-c515fc9e9f73): created successfully Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45eaacf9-344b-456e-9962-fd365911c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (2dca30f0-d7f8-4dd3-bd46-64c3e9e73379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:48 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-12454900-cf15-4de8-9ce7-12f7f6ffc396 tempest-GroupSnapshotsTest-364060987 None] Created volume successfully. Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (f8fc0642-c6c4-4770-a87c-fd2528698293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e853c91-b217-494e-ad26-67e8fbba85ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e853c91-b217-494e-ad26-67e8fbba85ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204359977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee7f693-75ef-4422-9b4a-c9a4752528e2,host='devstack@QuobyteHD#QuobyteHD',id=d50d49f1-4a44-4aa5-879e-d02c69bfab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:49Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbab9b82-1773-4341-a7b9-0be81a44fa38),volume_type_id=dbab9b82-1773-4341-a7b9-0be81a44fa38)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e2b4f5-df4e-49fb-b80a-974116ecf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e2b4f5-df4e-49fb-b80a-974116ecf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b760cf-ee5c-47fc-abf7-67d446304db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b760cf-ee5c-47fc-abf7-67d446304db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50d49f1-4a44-4aa5-879e-d02c69bfab20', 'volume_name': 'volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf750e7d-4921-4a1c-a9f7-cc6e7081133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf750e7d-4921-4a1c-a9f7-cc6e7081133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5642a3a6-c686-43f3-96f2-ed2b9a286028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:49 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Volume d50d49f1-4a44-4aa5-879e-d02c69bfab20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20', 'volume_size': 1} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:49 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 1073741824" returned: 0 in 0.632s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:49 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 Apr 10 16:18:49 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0743fa16-0d12-4a8b-b314-a1ceee3ec921 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" by "attach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0743fa16-0d12-4a8b-b314-a1ceee3ec921 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" acquired by "attach_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0743fa16-0d12-4a8b-b314-a1ceee3ec921 tempest-VolumesActionsTest-1745927240 None] Attaching volume d4f4573b-7ca4-4cd3-8ed4-3f5e174229be to instance ef73fc3f-88f8-4d93-9632-5bdd15b21643 at mountpoint /dev/vdb on host None. Apr 10 16:18:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0743fa16-0d12-4a8b-b314-a1ceee3ec921 tempest-VolumesActionsTest-1745927240 None] Attach volume completed successfully. Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0743fa16-0d12-4a8b-b314-a1ceee3ec921 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" released by "attach_volume" :: held 0.074s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:49 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5" returned: 0 in 0.455s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2039993895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bbf4d8-8815-41d0-9e46-68abe5fcdd13,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0d86cc17e546909aaf35eec2e10849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:48Z,use_quota=True,user_id='ccec968eb5f748bbb8936eba53f62b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Creating volume 92bbf4d8-8815-41d0-9e46-68abe5fcdd13 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:49 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8642ec6e-f8e8-4b20-9469-bba2659e0c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94e89ba-1c1c-41cc-852b-c77ab2537c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:49 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 1073741824 Apr 10 16:18:49 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:49 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Volume volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 (b3b6f335-06ae-4c73-835c-a8e1088f44b5): created successfully Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94e89ba-1c1c-41cc-852b-c77ab2537c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Flow 'volume_create_manager' (e34ce8ee-052c-419b-ab72-9b80343ca815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3eed860e-0d2b-4bdd-8493-301abd9e2283 tempest-SnapshotsActionsTest-2061706042 None] Created volume successfully. Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a52fd767-68b6-4ddf-947c-ecf912b2cb51 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-detach_volume" by "detach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a52fd767-68b6-4ddf-947c-ecf912b2cb51 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:50 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a52fd767-68b6-4ddf-947c-ecf912b2cb51 tempest-VolumesActionsTest-1745927240 None] Detaching volume d4f4573b-7ca4-4cd3-8ed4-3f5e174229be from instance ef73fc3f-88f8-4d93-9632-5bdd15b21643. Apr 10 16:18:50 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a52fd767-68b6-4ddf-947c-ecf912b2cb51 tempest-VolumesActionsTest-1745927240 None] Detach volume completed successfully. Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a52fd767-68b6-4ddf-947c-ecf912b2cb51 tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:50 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 1073741824" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:50 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 Apr 10 16:18:50 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:50 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13" returned: 0 in 0.445s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ee7f693-75ef-4422-9b4a-c9a4752528e2,created_at=2026-04-10T14:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204359977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee7f693-75ef-4422-9b4a-c9a4752528e2,host='devstack@QuobyteHD#QuobyteHD',id=d50d49f1-4a44-4aa5-879e-d02c69bfab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:18:49Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbab9b82-1773-4341-a7b9-0be81a44fa38),volume_type_id=dbab9b82-1773-4341-a7b9-0be81a44fa38)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Creating volume d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:18:50 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=195,cinder:SELECT=175,cinder:INSERT=52,cinder:DELETE=9 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f7403c-aebe-452d-819f-f24348878996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:50 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 1073741824 Apr 10 16:18:50 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af482de-b7f9-4eed-a81a-ea2cdd1bf183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:50 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Volume volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 (92bbf4d8-8815-41d0-9e46-68abe5fcdd13): created successfully Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af482de-b7f9-4eed-a81a-ea2cdd1bf183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Flow 'volume_create_manager' (71f6511e-05f4-47e8-b6ca-6c4e9931fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:50 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-62209ac2-d25e-4523-877f-3c40350f9762 tempest-VolumesListTestJSON-378093126 None] Created volume successfully. Apr 10 16:18:51 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 1073741824" returned: 0 in 0.549s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:51 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 Apr 10 16:18:51 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:51 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.833s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5642a3a6-c686-43f3-96f2-ed2b9a286028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00df9a4-98d7-4b19-8b8d-22fe50e772e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Creating offline snapshot d920b543-faee-4e47-9e0b-fbea72e502b0 of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:18:51 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Volume volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 (d50d49f1-4a44-4aa5-879e-d02c69bfab20): created successfully Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00df9a4-98d7-4b19-8b8d-22fe50e772e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (f8fc0642-c6c4-4770-a87c-fd2528698293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f52822b-34cd-48f4-a955-76351c17e78f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:51 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3cc11739-fd51-4f1f-b9a0-cba14742ea73 tempest-GroupSnapshotsTest-364060987 None] Created volume successfully. Apr 10 16:18:52 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 Apr 10 16:18:52 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:52 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-525eaf03-0433-4a66-b0fd-bafca55b0e80 tempest-GroupSnapshotsTest-364060987 None] Update group completed successfully. Apr 10 16:18:52 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5" returned: 0 in 0.612s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:52 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 1G Apr 10 16:18:52 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:53 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 1G" returned: 0 in 0.607s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:53 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:18:53 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=231,cinder:INSERT=47,cinder:SELECT=178,cinder:DELETE=22 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:18:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2d628efb-5c10-458c-a73e-9d1c5e7423a3 tempest-GroupSnapshotsTest-364060987 None] Update group completed successfully. Apr 10 16:18:53 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.566s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:53 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 is being set with open permissions: ugo+rw Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:53 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:18:53 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "cinder-92bbf4d8-8815-41d0-9e46-68abe5fcdd13-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-92bbf4d8-8815-41d0-9e46-68abe5fcdd13-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "cinder-quobyte-92bbf4d8-8815-41d0-9e46-68abe5fcdd13" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-quobyte-92bbf4d8-8815-41d0-9e46-68abe5fcdd13" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af25167-aa89-44db-a8f6-707ce4c4a8c9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:53 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 Apr 10 16:18:53 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:54 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.453s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:54 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info Apr 10 16:18:54 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:54 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13" returned: 0 in 0.508s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:54 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13 Apr 10 16:18:54 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:54 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info" returned: 0 in 0.468s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:54 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info is being set with open permissions: ugo+rw Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:54 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info Apr 10 16:18:54 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6558c9af-cecf-426e-a66f-9f21c91959d0 tempest-GroupSnapshotsTest-364060987 None] Update group completed successfully. Apr 10 16:18:54 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-92bbf4d8-8815-41d0-9e46-68abe5fcdd13" returned: 0 in 0.470s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-quobyte-92bbf4d8-8815-41d0-9e46-68abe5fcdd13" released by "delete_volume" :: held 0.998s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Created reservations ['ab2161f5-3658-4b74-85b2-4f712cda0bbb', '6e7b2eae-69b1-4acc-a51b-79f831f87030', 'f627ffd0-2c1a-462a-8da7-c6975f916233', '904d3a9b-1fce-44b7-bd35-7d0f1c05cdfa'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:54 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:54 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:55 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.info" returned: 0 in 0.443s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.294s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:55 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6dba1cc3-6262-4abf-a2c3-ff6b9a3ee37f tempest-SnapshotsActionsTest-2061706042 None] Create snapshot completed successfully Apr 10 16:18:55 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:55 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:55 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Deleted volume successfully. Apr 10 16:18:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-11f07eef-224e-4db6-b788-5d276e1a0930 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-92bbf4d8-8815-41d0-9e46-68abe5fcdd13-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:55 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a74d8231-dda5-41a1-8590-fc325b1ebf83 tempest-GroupSnapshotsTest-364060987 None] Update group completed successfully. Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Acquiring lock "cinder-ce138d76-d88c-4008-8c09-fa5498aaf7ba-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Lock "cinder-ce138d76-d88c-4008-8c09-fa5498aaf7ba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Acquiring lock "cinder-quobyte-ce138d76-d88c-4008-8c09-fa5498aaf7ba" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Lock "cinder-quobyte-ce138d76-d88c-4008-8c09-fa5498aaf7ba" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[66117b6b-71c1-4f9d-a1ec-a24422fc0dfe]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:56 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba Apr 10 16:18:56 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Creating offline snapshot 6c43a41f-ecb5-43e3-b38d-ee92d78fa486 of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec1d590-4560-4ad9-9f7a-9af22242be13]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:56 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:18:56 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:56 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba" returned: 0 in 0.558s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:56 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba Apr 10 16:18:56 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:57 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.573s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:57 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 1G Apr 10 16:18:57 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:57 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] GroupSnapshot f4564e64-381f-406e-8a9f-7ebd3842029f: creating. Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ce138d76-d88c-4008-8c09-fa5498aaf7ba" returned: 0 in 0.551s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Lock "cinder-quobyte-ce138d76-d88c-4008-8c09-fa5498aaf7ba" released by "delete_volume" :: held 1.145s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Group snapshot f4564e64-381f-406e-8a9f-7ebd3842029f: creating. {{(pid=82117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Created reservations ['5452b788-c513-4518-89cb-8f29f840d565', 'd7768111-4ae3-44c6-a099-0b226d252c43', '14bd9d75-a496-4ea0-aba7-66ab5564f3df', 'a770a62f-2529-48b1-895f-80e606d9eb88'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:57 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:57 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:57 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 1G" returned: 0 in 0.561s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:57 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 Apr 10 16:18:57 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:57 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.571s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Deleted volume successfully. Apr 10 16:18:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e2268eb-b67d-459a-91dc-d33c614ed70b tempest-VolumesListTestJSON-378093126 None] Lock "cinder-ce138d76-d88c-4008-8c09-fa5498aaf7ba-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:58 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:58 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 is being set with open permissions: ugo+rw Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:58 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 Apr 10 16:18:58 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "cinder-e371e0d3-d4b7-4eef-a68a-6eb47e294237-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-e371e0d3-d4b7-4eef-a68a-6eb47e294237-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "cinder-quobyte-e371e0d3-d4b7-4eef-a68a-6eb47e294237" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-quobyte-e371e0d3-d4b7-4eef-a68a-6eb47e294237" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9b5fe6-7c44-452d-a817-40b8a765a47e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:58 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 Apr 10 16:18:58 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:58 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486" returned: 0 in 0.429s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.355s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:58 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-148bbc30-864c-495d-8bb6-c56f3235171d tempest-SnapshotsActionsTest-2061706042 None] Create snapshot completed successfully Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Creating offline snapshot 9b4e3352-314d-4862-8774-617f290193d2 of volume d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee0366-21a4-45bf-9783-ee09130db2b4]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:58 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 Apr 10 16:18:58 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:58 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237" returned: 0 in 0.484s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:58 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237 Apr 10 16:18:58 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:59 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20" returned: 0 in 0.481s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:59 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 1G Apr 10 16:18:59 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:59 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e371e0d3-d4b7-4eef-a68a-6eb47e294237" returned: 0 in 0.423s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-quobyte-e371e0d3-d4b7-4eef-a68a-6eb47e294237" released by "delete_volume" :: held 0.928s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Created reservations ['b68f3b88-ab67-43b3-9f2e-23bbe68610e5', 'cc60ca26-da2b-49f4-9a47-83060f622712', '21a75692-bd93-4d6d-8ced-9d7f86aa28c3', '50b8ebff-515f-4d22-ba17-cc3043f8c4d7'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:59 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:18:59 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:59 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 1G" returned: 0 in 0.529s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:59 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 Apr 10 16:18:59 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-6c43a41f-ecb5-43e3-b38d-ee92d78fa486-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-6c43a41f-ecb5-43e3-b38d-ee92d78fa486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:59 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.522s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:18:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Deleted volume successfully. Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-6c43a41f-ecb5-43e3-b38d-ee92d78fa486" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-6c43a41f-ecb5-43e3-b38d-ee92d78fa486" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Deleting offline snapshot 6c43a41f-ecb5-43e3-b38d-ee92d78fa486 of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] snapshot_file for this snap is: volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b0f6fc7d-5296-4270-b65f-4644eb422a77 tempest-VolumesListTestJSON-378093126 None] Lock "cinder-e371e0d3-d4b7-4eef-a68a-6eb47e294237-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[316faa2a-3e80-4cd5-8668-e859c1be30f6]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:18:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:18:59 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 Apr 10 16:18:59 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:00 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2" returned: 0 in 0.560s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:00 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:00 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 Apr 10 16:19:00 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:00 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486" returned: 0 in 0.562s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbc65d3-637c-48a1-badb-92790bb292ba]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:00 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:00 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:00 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2" returned: 0 in 0.459s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:00 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info Apr 10 16:19:00 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:00 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.503s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:00 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 Apr 10 16:19:00 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:01 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info" returned: 0 in 0.477s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:01 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:01 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info Apr 10 16:19:01 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Flow 'volume_create_manager' (24a14981-652b-4630-89b6-6cd0339f8119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6c63a7-5ec6-4f28-9fb0-6bc95344ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6c63a7-5ec6-4f28-9fb0-6bc95344ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-160493089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3cf377-6ce6-4499-b5fc-f78874956f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe8c5d14277472ca33e85aa8f70431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:01Z,use_quota=True,user_id='b6172319dc484f6e801b994efb6c06d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033c29f7-764e-445f-94b3-629d08b390ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033c29f7-764e-445f-94b3-629d08b390ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef15aa44-37a5-4a6c-a7f8-7ad2ff7278cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef15aa44-37a5-4a6c-a7f8-7ad2ff7278cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3cf377-6ce6-4499-b5fc-f78874956f27', 'volume_name': 'volume-eb3cf377-6ce6-4499-b5fc-f78874956f27', 'volume_size': 2}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4996e6a0-fc08-4115-9900-4b2f6484ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4996e6a0-fc08-4115-9900-4b2f6484ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c1f1f2-6292-42a5-aa43-0b89a5318496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:01 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Volume eb3cf377-6ce6-4499-b5fc-f78874956f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3cf377-6ce6-4499-b5fc-f78874956f27', 'volume_size': 2} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:01 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486" returned: 0 in 0.570s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:01 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486 Apr 10 16:19:01 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:01 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.info" returned: 0 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Creating offline snapshot c96349d0-722b-4009-8ee5-e03a5baec6ce of volume 136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b468c-f474-42b5-89ef-c3a81053119b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:01 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 Apr 10 16:19:01 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:01 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.6c43a41f-ecb5-43e3-b38d-ee92d78fa486" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-6c43a41f-ecb5-43e3-b38d-ee92d78fa486" released by "_delete_snapshot" :: held 2.126s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" released by "delete_snapshot" :: held 2.141s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:02 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Created reservations ['8efa8e3d-4d4b-4c3b-b64a-fdff67bf0d75', '9151613b-b81d-44eb-a986-b742b6368bbc', 'c82c8305-ff4e-420b-b5e0-efd9a956a34f', 'bce1caec-98f8-4d3e-8047-3f4c6baaedb0'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:02 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Delete snapshot completed successfully. Apr 10 16:19:02 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5abe8bdc-7f6d-408a-a105-3df456a6d200 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-6c43a41f-ecb5-43e3-b38d-ee92d78fa486-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:02 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73" returned: 0 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:02 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce 1G Apr 10 16:19:02 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:02 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce 1G" returned: 0 in 0.498s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:02 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce Apr 10 16:19:02 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:03 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce" returned: 0 in 0.471s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:03 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:19:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:03 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce Apr 10 16:19:03 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:03 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce" returned: 0 in 0.434s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:03 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info Apr 10 16:19:03 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:04 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info" returned: 0 in 0.422s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:04 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:04 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info Apr 10 16:19:04 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:04 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.info" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-160493089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3cf377-6ce6-4499-b5fc-f78874956f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe8c5d14277472ca33e85aa8f70431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:01Z,use_quota=True,user_id='b6172319dc484f6e801b994efb6c06d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Creating volume eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:04 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 2147483648 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:04 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 2147483648 Apr 10 16:19:04 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:04 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-85f37afe-9a21-4dda-ac0e-95437957955d tempest-GroupSnapshotsTest-364060987 None] group_snapshot f4564e64-381f-406e-8a9f-7ebd3842029f: created successfully Apr 10 16:19:05 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 2147483648" returned: 0 in 0.522s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:05 devstack sudo[87010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 Apr 10 16:19:05 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:05 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27" returned: 0 in 0.432s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.669s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c1f1f2-6292-42a5-aa43-0b89a5318496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3cf377-6ce6-4499-b5fc-f78874956f27', 'volume_size': 2}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa347b1-c88d-4f87-8eb9-ad24f04106d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05ffed4-a5fa-4b08-a7b1-0a91125ab48a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Volume volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 (eb3cf377-6ce6-4499-b5fc-f78874956f27): created successfully Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa347b1-c88d-4f87-8eb9-ad24f04106d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Flow 'volume_create_manager' (24a14981-652b-4630-89b6-6cd0339f8119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-50ceb429-6d45-4273-8e6b-948f7ced0465 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Created volume successfully. Apr 10 16:19:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] group_snapshot f4564e64-381f-406e-8a9f-7ebd3842029f: deleting Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] group_snapshot f4564e64-381f-406e-8a9f-7ebd3842029f: deleting {{(pid=82117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 16:19:05 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:05 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-d50d49f1-4a44-4aa5-879e-d02c69bfab20" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-d50d49f1-4a44-4aa5-879e-d02c69bfab20" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-9b4e3352-314d-4862-8774-617f290193d2" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-9b4e3352-314d-4862-8774-617f290193d2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Deleting offline snapshot 9b4e3352-314d-4862-8774-617f290193d2 of volume d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] snapshot_file for this snap is: volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6376d9e-3ed9-4340-8537-0b7ee29963d6]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:05 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 Apr 10 16:19:05 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:06 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.597s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a25e2e-e3f7-458c-a21c-d187b30d4b1b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:06 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:06 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:06 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2" returned: 0 in 0.578s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f867861e-d3d9-4a66-9ae0-903594fc2343]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:06 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 Apr 10 16:19:06 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:06 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.478s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.9b31165e-3e85-43ab-85b8-4487cf63db009vcp3bj4.img {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:06 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.9b31165e-3e85-43ab-85b8-4487cf63db009vcp3bj4.img Apr 10 16:19:06 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:06 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20" returned: 0 in 0.494s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:06 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 Apr 10 16:19:06 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:07 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2" returned: 0 in 1.077s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:07 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2 Apr 10 16:19:07 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:08 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.9b31165e-3e85-43ab-85b8-4487cf63db009vcp3bj4.img" returned: 0 in 2.049s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7706b-b9ed-46d7-a491-d1aeb6ed3462]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:08 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:08 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:08 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20.9b4e3352-314d-4862-8774-617f290193d2" returned: 0 in 1.011s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-9b4e3352-314d-4862-8774-617f290193d2" released by "_delete_snapshot" :: held 3.229s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-d50d49f1-4a44-4aa5-879e-d02c69bfab20" released by "delete_snapshot" :: held 3.243s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-136b237a-aad0-4230-a7d7-c515fc9e9f73" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-136b237a-aad0-4230-a7d7-c515fc9e9f73" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-c96349d0-722b-4009-8ee5-e03a5baec6ce" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-c96349d0-722b-4009-8ee5-e03a5baec6ce" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Deleting offline snapshot c96349d0-722b-4009-8ee5-e03a5baec6ce of volume 136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] snapshot_file for this snap is: volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[770a7121-d9db-45a3-99a2-45a9ec3a6e0b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:08 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce Apr 10 16:19:08 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:09 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.607s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.9b31165e-3e85-43ab-85b8-4487cf63db009vcp3bj4.img {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:19:09 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Converted 1024.00 MB image at 499.42 MB/s Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] 9b31165e-3e85-43ab-85b8-4487cf63db00 was raw, no need to convert to raw {{(pid=82117) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 16:19:09 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce" returned: 0 in 0.515s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136b237a-aad0-4230-a7d7-c515fc9e9f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ed82e-454a-4367-95c0-c8c370a2d67f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:09 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 Apr 10 16:19:09 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:10 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73" returned: 0 in 0.556s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:10 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce Apr 10 16:19:10 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:10 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce" returned: 0 in 0.466s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:10 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce Apr 10 16:19:10 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:10 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73.c96349d0-722b-4009-8ee5-e03a5baec6ce" returned: 0 in 0.421s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-c96349d0-722b-4009-8ee5-e03a5baec6ce" released by "_delete_snapshot" :: held 2.026s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-136b237a-aad0-4230-a7d7-c515fc9e9f73" released by "delete_snapshot" :: held 2.039s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:11 devstack cinder-volume[82117]: WARNING cinder.quota [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-863073973 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-863073973, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:19:11 devstack cinder-volume[82117]: WARNING cinder.quota [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-863073973 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-863073973, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:19:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Created reservations ['b60a3892-18d4-4245-92d5-c1d091e2fe3e', '471e64c6-7a4c-4218-96c4-4d6a33fb5092', '672a185c-3578-4238-b6c4-f209183cd756', '86974896-8a93-458d-96e5-60230479dd67'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] Created reservations ['ed79cdd0-5177-48e6-9ac3-2714f370e334', '077d607d-6635-4bd5-b879-e65ed086cf1b', '92379745-e21d-460e-969a-0eded82f8de9', 'bcd2c6f6-d05b-4b70-ac8c-535a897243f5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2a00ac85-0e64-4555-a005-986650111e4d tempest-GroupSnapshotsTest-364060987 None] group_snapshot f4564e64-381f-406e-8a9f-7ebd3842029f: deleted successfully Apr 10 16:19:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-136b237a-aad0-4230-a7d7-c515fc9e9f73" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-136b237a-aad0-4230-a7d7-c515fc9e9f73" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:12 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe12586-465a-432c-9115-2c9d76912ed3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:12 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 Apr 10 16:19:12 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:12 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73" returned: 0 in 0.508s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:12 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73 Apr 10 16:19:12 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:13 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-136b237a-aad0-4230-a7d7-c515fc9e9f73" returned: 0 in 0.462s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-136b237a-aad0-4230-a7d7-c515fc9e9f73" released by "delete_volume" :: held 1.048s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-d50d49f1-4a44-4aa5-879e-d02c69bfab20" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-d50d49f1-4a44-4aa5-879e-d02c69bfab20" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[806f6109-205a-4a43-af4e-7dcf38c0ce46]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:13 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 Apr 10 16:19:13 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:13 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20" returned: 0 in 0.550s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:13 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20 Apr 10 16:19:13 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:14 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d50d49f1-4a44-4aa5-879e-d02c69bfab20" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-d50d49f1-4a44-4aa5-879e-d02c69bfab20" released by "delete_volume" :: held 1.050s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Created reservations ['66dbb861-815b-463c-8461-3fec6e507b9f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:14 devstack cinder-volume[82117]: WARNING cinder.quota [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-863073973 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-863073973, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Created reservations ['be795518-6b35-4faf-a7fd-beec79ab14f2', '8a206a12-e73e-44f8-be3b-84df307e862c', 'a85e291c-82ce-4ca8-960c-65849618c001', '96bdebd9-a942-4599-8151-939401c96cfe'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Created reservations ['8b79f130-b222-431a-bc04-47062e0539f7', 'daa98c15-cc71-47b0-9c50-9ec356441eb4', '41f7a1a0-fc77-4c27-9a45-c67fbc07a9fc', '8363e6c3-41d3-42fb-a86e-60e6f7d491f1'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:14 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:14 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:15 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1330b0cd-7ae3-4d2d-8d14-7438bbcecc1f tempest-GroupSnapshotsTest-364060987 None] Delete group completed successfully. Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:15 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:15 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c4e35dde-9eab-4ac5-b2df-2974ef760912 tempest-GroupSnapshotsTest-364060987 None] Group tempest-GroupSnapshotsTest-Group-936017040: creating Apr 10 16:19:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c4e35dde-9eab-4ac5-b2df-2974ef760912 tempest-GroupSnapshotsTest-364060987 None] Group tempest-GroupSnapshotsTest-Group-936017040: created successfully Apr 10 16:19:15 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c4e35dde-9eab-4ac5-b2df-2974ef760912 tempest-GroupSnapshotsTest-364060987 None] Create group completed successfully. Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.457s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (dbb41ef1-2303-40f5-88e0-01a595ebb5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa592728-1b58-476b-94d3-befe0b014d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa592728-1b58-476b-94d3-befe0b014d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150544007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd253247-3853-4bf9-8764-fd3ff0338bdf,host='devstack@QuobyteHD#QuobyteHD',id=a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:18Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a83b692-0f10-47bf-9553-b02332a6560d),volume_type_id=2a83b692-0f10-47bf-9553-b02332a6560d)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5daf6a4-45ad-460d-a93a-6a2e1d238f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5daf6a4-45ad-460d-a93a-6a2e1d238f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caf4e93-4a3d-417f-b532-c454f433dcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caf4e93-4a3d-417f-b532-c454f433dcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd', 'volume_name': 'volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e204731-8c3a-4df5-ba32-5bd2fb446839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e204731-8c3a-4df5-ba32-5bd2fb446839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30c9cbb-83dd-4fa9-aca6-2e9fd74a5507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Volume a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd', 'volume_size': 1} Apr 10 16:19:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.604s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Uploaded volume to glance image-id: 9b31165e-3e85-43ab-85b8-4487cf63db00. {{(pid=82117) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8b3db733-0ee4-4955-b675-21527c462655 tempest-VolumesActionsTest-1745927240 None] Copy volume to image completed successfully. Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Creating offline snapshot 0884192c-38e5-4a66-864e-4da0d6433de7 of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacdcfdc-04a4-4e39-b749-75b8994496fc]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:19 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:19 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:19 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.528s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:19 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 1G Apr 10 16:19:19 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:20 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 1G" returned: 0 in 0.524s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:20 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 Apr 10 16:19:20 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:20 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7" returned: 0 in 0.421s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:20 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 is being set with open permissions: ugo+rw Apr 10 16:19:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:20 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 Apr 10 16:19:20 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:21 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7" returned: 0 in 0.400s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.168s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Creating offline snapshot d2e31b66-15d0-4ced-ba17-7508efb07db6 of volume eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:21 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-81ca5d0a-0054-4ee2-842e-8e546f72409c tempest-SnapshotsActionsTest-2061706042 None] Create snapshot completed successfully Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7704c04-2e52-4140-aa03-99d28c53ec1a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:21 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 Apr 10 16:19:21 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:21 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27" returned: 0 in 0.457s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 2G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:21 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 2G Apr 10 16:19:21 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-0884192c-38e5-4a66-864e-4da0d6433de7-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-0884192c-38e5-4a66-864e-4da0d6433de7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-0884192c-38e5-4a66-864e-4da0d6433de7" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-0884192c-38e5-4a66-864e-4da0d6433de7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Deleting offline snapshot 0884192c-38e5-4a66-864e-4da0d6433de7 of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] snapshot_file for this snap is: volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4068a1-ed54-4de7-b2b5-3555b2166d78]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:21 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 Apr 10 16:19:21 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:22 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 2G" returned: 0 in 0.493s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:22 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 Apr 10 16:19:22 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:22 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7" returned: 0 in 0.485s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da7589c-6bec-47fe-8cce-91afd20511da]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:22 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:22 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:22 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6" returned: 0 in 0.441s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:22 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 is being set with open permissions: ugo+rw Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:22 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 Apr 10 16:19:22 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:22 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:22 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 Apr 10 16:19:22 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6" returned: 0 in 0.440s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:22 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:23 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info Apr 10 16:19:23 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:23 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:23 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7 Apr 10 16:19:23 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:23 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info" returned: 0 in 0.410s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:23 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info is being set with open permissions: ugo+rw Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:23 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info Apr 10 16:19:23 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:23 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.0884192c-38e5-4a66-864e-4da0d6433de7" returned: 0 in 0.404s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-0884192c-38e5-4a66-864e-4da0d6433de7" released by "_delete_snapshot" :: held 1.956s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" released by "delete_snapshot" :: held 1.968s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Created reservations ['968adb5f-7716-4260-9630-6deb54720e85', '539438cb-577b-4cc4-916d-049e26a2904c', '1f523e16-9175-41a9-ab80-d1a91f1775d4', '4cfa6f90-8262-453e-a58a-41a930170cd5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:23 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Delete snapshot completed successfully. Apr 10 16:19:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-401ffd6d-9f28-4a09-830b-4825825fd5c1 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-0884192c-38e5-4a66-864e-4da0d6433de7-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:24 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.info" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.355s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fd253247-3853-4bf9-8764-fd3ff0338bdf,created_at=2026-04-10T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150544007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd253247-3853-4bf9-8764-fd3ff0338bdf,host='devstack@QuobyteHD#QuobyteHD',id=a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15d41a724204300b49ceec920a85b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:18Z,use_quota=True,user_id='9db32c488b894278aa7fa54241177608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a83b692-0f10-47bf-9553-b02332a6560d),volume_type_id=2a83b692-0f10-47bf-9553-b02332a6560d)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Creating volume a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:24 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:24 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd 1073741824 Apr 10 16:19:24 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e3ef0fe7-06e5-4bb2-acb5-7f751f51b269 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Create snapshot completed successfully Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "cinder-d2e31b66-15d0-4ced-ba17-7508efb07db6-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-d2e31b66-15d0-4ced-ba17-7508efb07db6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "cinder-quobyte-eb3cf377-6ce6-4499-b5fc-f78874956f27" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-quobyte-eb3cf377-6ce6-4499-b5fc-f78874956f27" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "cinder-quobyte-d2e31b66-15d0-4ced-ba17-7508efb07db6" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-quobyte-d2e31b66-15d0-4ced-ba17-7508efb07db6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Deleting offline snapshot d2e31b66-15d0-4ced-ba17-7508efb07db6 of volume eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] snapshot_file for this snap is: volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a91100-7826-4909-ad83-72bb29d71a81]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:24 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 Apr 10 16:19:24 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:24 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd 1073741824" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:24 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd Apr 10 16:19:24 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:24 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6" returned: 0 in 0.489s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb3cf377-6ce6-4499-b5fc-f78874956f27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b26f92-06fd-475f-b2a7-23ab4f6103e8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:25 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 Apr 10 16:19:25 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:25 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" returned: 0 in 0.422s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.036s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30c9cbb-83dd-4fa9-aca6-2e9fd74a5507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041c93de-934c-47e1-b06d-cd78767c63f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe47fd-cc07-42d3-bd05-1d0294dad15a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:25 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Volume volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd (a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd): created successfully Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041c93de-934c-47e1-b06d-cd78767c63f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Flow 'volume_create_manager' (dbb41ef1-2303-40f5-88e0-01a595ebb5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-88a1d54e-9183-4260-8261-c6ead0639b6e tempest-GroupSnapshotsTest-364060987 None] Created volume successfully. Apr 10 16:19:25 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:25 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:25 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27" returned: 0 in 0.503s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:25 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 Apr 10 16:19:25 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:25 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.471s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[02181d5b-e263-45fe-837c-d8a64cf71f18]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:25 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:25 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:25 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6" returned: 0 in 0.469s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:25 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6 Apr 10 16:19:25 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] GroupSnapshot 2918eb42-ff38-4fb7-a07f-c25a90a39123: creating. Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Group snapshot 2918eb42-ff38-4fb7-a07f-c25a90a39123: creating. {{(pid=82117) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:26 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.559s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:26 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img Apr 10 16:19:26 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:26 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27.d2e31b66-15d0-4ced-ba17-7508efb07db6" returned: 0 in 0.460s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-quobyte-d2e31b66-15d0-4ced-ba17-7508efb07db6" released by "_delete_snapshot" :: held 1.985s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-quobyte-eb3cf377-6ce6-4499-b5fc-f78874956f27" released by "delete_snapshot" :: held 1.996s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Created reservations ['dea2d4bd-61f6-4ff6-ac9f-ea6b928beb22', 'e8060c1f-9cbc-465a-9b4b-4f452e980dee', '6d393fcf-e689-4cda-ae42-c512efeac6c1', '387bc3d4-4a22-473e-ac51-415a50bc7008'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Delete snapshot completed successfully. Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4b0dcbdd-c698-4d56-b0a2-e8e29ed65c8f tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-d2e31b66-15d0-4ced-ba17-7508efb07db6-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "cinder-eb3cf377-6ce6-4499-b5fc-f78874956f27-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-eb3cf377-6ce6-4499-b5fc-f78874956f27-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "cinder-quobyte-eb3cf377-6ce6-4499-b5fc-f78874956f27" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-quobyte-eb3cf377-6ce6-4499-b5fc-f78874956f27" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b14f5-708b-4e0d-953f-2944d0f57007]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:26 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 Apr 10 16:19:26 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:28 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27" returned: 0 in 1.532s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:28 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img" returned: 0 in 2.024s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c6e17-02f8-4afa-9032-1b5d75bef994]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:28 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27 Apr 10 16:19:28 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:28 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:28 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:28 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-eb3cf377-6ce6-4499-b5fc-f78874956f27" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-quobyte-eb3cf377-6ce6-4499-b5fc-f78874956f27" released by "delete_volume" :: held 2.011s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Created reservations ['55b93966-006f-4bf8-adc7-e00ad50058e8', '19de6b73-582e-45fb-9d27-c41324610544', '791a8de2-4ff7-4e90-a06a-7e4b8a364b6d', '033e1443-bafe-4d13-b9ba-adb3969f0187'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:28 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:28 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:28 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.585s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:19:28 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Converted 1024.00 MB image at 505.42 MB/s Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] 00ce31eb-8c76-45cd-bc68-ed11b5f0932d was raw, converting to qcow2 {{(pid=82117) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef39242-874d-43ef-82ec-022856706673]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:28 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img Apr 10 16:19:28 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:29 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Deleted volume successfully. Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a86b4aa0-c73a-45ab-b58e-d079363292e3 tempest-VolumesSnapshotNegativeTestJSON-573629507 None] Lock "cinder-eb3cf377-6ce6-4499-b5fc-f78874956f27-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:29 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:29 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img Apr 10 16:19:29 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:29 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img" returned: 1 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:19:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:29 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y Apr 10 16:19:29 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:30 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y" returned: 0 in 0.459s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Image conversion details: src /opt/stack/data/cinder/conversion/d4f4573b-7ca4-4cd3-8ed4-3f5e174229be.temp_image.00ce31eb-8c76-45cd-bc68-ed11b5f0932de4nfgmzw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:19:30 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47b28c-960b-42b4-bc66-10f0ad84611c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:30 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y Apr 10 16:19:30 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (fb43167d-d1b4-4fd2-a875-12bedc2dbdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7cd961-94b9-4b3b-ac8e-9eb96fe6df2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7cd961-94b9-4b3b-ac8e-9eb96fe6df2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837126415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03e0b9b-6afb-4701-8512-b42330b6efb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5527d1e0-24a4-47d6-8ee3-09ea0993c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5527d1e0-24a4-47d6-8ee3-09ea0993c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c1265b-bf7f-4cd8-b668-610f813ea392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c1265b-bf7f-4cd8-b668-610f813ea392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03e0b9b-6afb-4701-8512-b42330b6efb3', 'volume_name': 'volume-c03e0b9b-6afb-4701-8512-b42330b6efb3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d92376-ac8e-4613-8f69-78906837ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d92376-ac8e-4613-8f69-78906837ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9688a286-a457-4196-9fdc-23f1f57c4a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume c03e0b9b-6afb-4701-8512-b42330b6efb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03e0b9b-6afb-4701-8512-b42330b6efb3', 'volume_size': 1} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (99c729e2-fbf8-4ec9-bb3c-8d8969bc21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb460b69-6560-402e-8061-b22ded2ee3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb460b69-6560-402e-8061-b22ded2ee3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831605419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae15db84-bf05-4982-94c3-9b725c2b2258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d720ffb-0b80-43d3-a764-79f53936d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d720ffb-0b80-43d3-a764-79f53936d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afec4f3-6904-4ebd-81a5-3c632a5a9b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afec4f3-6904-4ebd-81a5-3c632a5a9b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae15db84-bf05-4982-94c3-9b725c2b2258', 'volume_name': 'volume-ae15db84-bf05-4982-94c3-9b725c2b2258', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad82ded-98c3-45ec-9f42-15dddf645b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad82ded-98c3-45ec-9f42-15dddf645b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb10485f-27a7-486e-95e3-95808193b37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Volume ae15db84-bf05-4982-94c3-9b725c2b2258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae15db84-bf05-4982-94c3-9b725c2b2258', 'volume_size': 1} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (15135723-2f7e-4377-b214-48624d210f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5244538e-1773-44a3-93ec-135618614ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5244538e-1773-44a3-93ec-135618614ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1750196486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8eddf08-117c-4baa-99fb-db817e7b7f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f8775e-5a42-42f4-97d7-74d931706351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f8775e-5a42-42f4-97d7-74d931706351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf03743-5d69-4d98-a7af-fd36ff2f8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf03743-5d69-4d98-a7af-fd36ff2f8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8eddf08-117c-4baa-99fb-db817e7b7f1b', 'volume_name': 'volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9c0bbc-3df9-435a-ba51-b1abdf8d353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9c0bbc-3df9-435a-ba51-b1abdf8d353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3591e8-0819-46fa-986c-adddfc857e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:30 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume c8eddf08-117c-4baa-99fb-db817e7b7f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b', 'volume_size': 1} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_exl0xp8y" returned: 0 in 0.551s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (75b19c72-f008-4dc5-a00a-6f946b50cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22d1fc7-700e-4f50-acaa-67b44200857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22d1fc7-700e-4f50-acaa-67b44200857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1541070236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5bbf4f-cc9f-4ec5-8481-9fd041a41515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ee5376-31dd-405a-8d92-d94782da2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ee5376-31dd-405a-8d92-d94782da2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039857fb-04a9-4ae7-ad39-f9bd9a41c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039857fb-04a9-4ae7-ad39-f9bd9a41c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5bbf4f-cc9f-4ec5-8481-9fd041a41515', 'volume_name': 'volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe18ebe-69ed-4c84-a0c0-2ff74b2e213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe18ebe-69ed-4c84-a0c0-2ff74b2e213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dc2760-d090-40f4-bf14-aedf334ea4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Volume cb5bbf4f-cc9f-4ec5-8481-9fd041a41515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515', 'volume_size': 1} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (6cb6b36c-aed3-4821-a093-e30be47f9158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb191b6-9749-43d7-834a-6b11e07e232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb191b6-9749-43d7-834a-6b11e07e232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129018187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22d16c1-b605-4113-96e6-0b5dc44b8c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595abe0e-78f1-4726-b4f9-45fb6ebe4534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595abe0e-78f1-4726-b4f9-45fb6ebe4534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ea9867-e29a-40bd-b08c-18f56af7e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ea9867-e29a-40bd-b08c-18f56af7e809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22d16c1-b605-4113-96e6-0b5dc44b8c66', 'volume_name': 'volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827ec697-0910-4d6b-9691-fd0a02e735bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827ec697-0910-4d6b-9691-fd0a02e735bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4449e9-79ba-4e89-ae2c-102db3fb9145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:31 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume b22d16c1-b605-4113-96e6-0b5dc44b8c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66', 'volume_size': 1} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.700s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Uploaded volume to glance image-id: 00ce31eb-8c76-45cd-bc68-ed11b5f0932d. {{(pid=82117) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.752s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Creating offline snapshot e153911d-8bef-4226-a555-a98892e0edcf of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:31 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a71e8d09-1fdb-49ee-b464-fb64ee97661b tempest-VolumesActionsTest-1745927240 None] Copy volume to image completed successfully. Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d4c53a-295e-4437-a29b-0cc3454be616]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:31 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:31 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:32 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.477s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:32 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf 1G Apr 10 16:19:32 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Acquiring lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Acquiring lock "cinder-quobyte-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Lock "cinder-quobyte-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d283ac-10dd-4fe0-abbf-3710c548bdf7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:32 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf 1G" returned: 0 in 0.561s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:32 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf Apr 10 16:19:32 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:33 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:33 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:33 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf" returned: 0 in 0.442s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:33 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf is being set with open permissions: ugo+rw Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:33 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf Apr 10 16:19:33 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:33 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:33 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be Apr 10 16:19:33 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:33 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf" returned: 0 in 0.427s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.659s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:33 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" returned: 0 in 0.420s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Creating offline snapshot 170cd9a2-9fb7-419d-9ce8-6ccbb844e751 of volume a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c829d5-db35-449e-b9b9-cbce47886c2f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Lock "cinder-quobyte-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be" released by "delete_volume" :: held 0.974s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3199f622-e68a-419f-a157-baa3c4f5a5d3 tempest-SnapshotsActionsTest-2061706042 None] Create snapshot completed successfully Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Created reservations ['f9735e9a-b3c1-47e3-979a-3be070f25cc6', '5e9a346d-ca58-4309-b043-bb9b0808706d', '6c39e1bf-5414-4f5e-8be8-8c849fbe8bfa', '04801f14-02e4-4e04-b1a3-04df8fb0405c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:33 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd Apr 10 16:19:33 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:34 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:34 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:34 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" returned: 0 in 0.495s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:34 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 1G Apr 10 16:19:34 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:34 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.422s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Deleted volume successfully. Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2a65c681-40b2-49d3-b1b0-0dd283e9fb4d tempest-VolumesActionsTest-1745927240 None] Lock "cinder-d4f4573b-7ca4-4cd3-8ed4-3f5e174229be-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-e153911d-8bef-4226-a555-a98892e0edcf-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-e153911d-8bef-4226-a555-a98892e0edcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-e153911d-8bef-4226-a555-a98892e0edcf" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-e153911d-8bef-4226-a555-a98892e0edcf" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Deleting offline snapshot e153911d-8bef-4226-a555-a98892e0edcf of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] snapshot_file for this snap is: volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ee69e-fd8d-4ebb-8506-78dcf47b6e71]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:34 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf Apr 10 16:19:34 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:34 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 1G" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:34 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 Apr 10 16:19:34 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:35 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf" returned: 0 in 0.523s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f53669-b13f-4ea2-b4ff-1d54957b38b3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:35 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:35 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:35 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751" returned: 0 in 0.470s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:35 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:35 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 Apr 10 16:19:35 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:35 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.508s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:35 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf Apr 10 16:19:35 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:35 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751" returned: 0 in 0.534s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:35 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info Apr 10 16:19:35 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:36 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf" returned: 0 in 0.540s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:36 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf Apr 10 16:19:36 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:36 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info" returned: 0 in 0.458s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:36 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:36 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info Apr 10 16:19:36 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:36 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.e153911d-8bef-4226-a555-a98892e0edcf" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-e153911d-8bef-4226-a555-a98892e0edcf" released by "_delete_snapshot" :: held 2.153s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" released by "delete_snapshot" :: held 2.168s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Created reservations ['8f5594c5-9a94-43b7-a5f5-20d037f2dc4f', '4dbedb65-4dea-41b0-8ae9-b88348c3e8eb', 'd7c40e61-9a28-435c-8f6e-08f60a399a15', 'dc26e825-f643-4850-a534-ce1eacda3158'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Delete snapshot completed successfully. Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-34a9d7d0-bab7-49f0-93c5-f3a9144aaaf0 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-e153911d-8bef-4226-a555-a98892e0edcf-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:36 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.info" returned: 0 in 0.478s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.237s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837126415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03e0b9b-6afb-4701-8512-b42330b6efb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Creating volume c03e0b9b-6afb-4701-8512-b42330b6efb3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:36 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:36 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 1073741824 Apr 10 16:19:36 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d3dfe53e-f302-4967-ab0b-49fc68007d74 tempest-GroupSnapshotsTest-364060987 None] group_snapshot 2918eb42-ff38-4fb7-a07f-c25a90a39123: created successfully Apr 10 16:19:37 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 1073741824" returned: 0 in 0.555s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:37 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 Apr 10 16:19:37 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] group_snapshot 2918eb42-ff38-4fb7-a07f-c25a90a39123: deleting Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] group_snapshot 2918eb42-ff38-4fb7-a07f-c25a90a39123: deleting {{(pid=82117) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-170cd9a2-9fb7-419d-9ce8-6ccbb844e751" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-170cd9a2-9fb7-419d-9ce8-6ccbb844e751" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Deleting offline snapshot 170cd9a2-9fb7-419d-9ce8-6ccbb844e751 of volume a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] snapshot_file for this snap is: volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb3f90a-3ffd-4999-853e-1495550c1054]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:37 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 Apr 10 16:19:37 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:38 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3" returned: 0 in 0.559s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.198s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831605419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae15db84-bf05-4982-94c3-9b725c2b2258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Creating volume ae15db84-bf05-4982-94c3-9b725c2b2258 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:38 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9688a286-a457-4196-9fdc-23f1f57c4a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03e0b9b-6afb-4701-8512-b42330b6efb3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:38 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 1073741824 Apr 10 16:19:38 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290c4a15-6df4-4b90-a37f-dd9cd44ec71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:38 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 (c03e0b9b-6afb-4701-8512-b42330b6efb3): created successfully Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290c4a15-6df4-4b90-a37f-dd9cd44ec71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (fb43167d-d1b4-4fd2-a875-12bedc2dbdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-03ead1c1-ad5f-4463-98d1-3b6055248cd3 tempest-CreateVolumesFromImageTest-1824449312 None] Created volume successfully. Apr 10 16:19:38 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdbed9a-3cad-4595-a973-7592d46281f9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:38 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd Apr 10 16:19:38 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:38 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 1073741824" returned: 0 in 0.557s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:38 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 Apr 10 16:19:38 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:38 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" returned: 0 in 0.547s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:38 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 Apr 10 16:19:38 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:39 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258" returned: 0 in 0.489s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.125s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1750196486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8eddf08-117c-4baa-99fb-db817e7b7f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Creating volume c8eddf08-117c-4baa-99fb-db817e7b7f1b {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:39 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb10485f-27a7-486e-95e3-95808193b37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae15db84-bf05-4982-94c3-9b725c2b2258', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112ce8b6-1691-43bf-8c32-0e477f60b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:39 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b 1073741824 Apr 10 16:19:39 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:39 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Volume volume-ae15db84-bf05-4982-94c3-9b725c2b2258 (ae15db84-bf05-4982-94c3-9b725c2b2258): created successfully Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112ce8b6-1691-43bf-8c32-0e477f60b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (99c729e2-fbf8-4ec9-bb3c-8d8969bc21d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:39 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-597f22ae-07e0-4881-9f0b-d32db169cd89 tempest-CreateVolumesFromImageTest-1824449312 None] Created volume successfully. Apr 10 16:19:39 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751" returned: 0 in 0.605s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:39 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751 Apr 10 16:19:39 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:39 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b 1073741824" returned: 0 in 0.697s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:39 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b Apr 10 16:19:39 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:40 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd.170cd9a2-9fb7-419d-9ce8-6ccbb844e751" returned: 0 in 0.531s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-170cd9a2-9fb7-419d-9ce8-6ccbb844e751" released by "_delete_snapshot" :: held 2.273s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" released by "delete_snapshot" :: held 2.284s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:40 devstack cinder-volume[82117]: WARNING cinder.quota [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1864453534 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1864453534, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:19:40 devstack cinder-volume[82117]: WARNING cinder.quota [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1864453534 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1864453534, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] Created reservations ['50323879-2006-4ac3-a0c8-3679c395859d', '38bba849-e9df-4b60-94d1-5741d6e62471', '4b38aa09-e80e-4898-b266-eb8eb209b87d', '0776863a-9af3-41f8-b6b8-2814e0059660'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e22af0ae-5e9c-4139-b05b-66a628ce40af tempest-GroupSnapshotsTest-364060987 None] group_snapshot 2918eb42-ff38-4fb7-a07f-c25a90a39123: deleted successfully Apr 10 16:19:40 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b" returned: 0 in 0.473s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.151s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1541070236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5bbf4f-cc9f-4ec5-8481-9fd041a41515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Creating volume cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:40 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3591e8-0819-46fa-986c-adddfc857e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:40 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 1073741824 Apr 10 16:19:40 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c693f1e3-ac81-48bf-bf49-69a00b04fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b (c8eddf08-117c-4baa-99fb-db817e7b7f1b): created successfully Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c693f1e3-ac81-48bf-bf49-69a00b04fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (15135723-2f7e-4377-b214-48624d210f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0be9e60d-501f-4848-9656-c020e35fbdb3 tempest-CreateVolumesFromImageTest-1824449312 None] Created volume successfully. Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Flow 'volume_create_manager' (98121689-a1ec-4440-867d-e855033d8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ad5ba7-1548-4d95-bdee-b67749aad671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ad5ba7-1548-4d95-bdee-b67749aad671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-722224602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003a6a51-73d8-4621-ac5c-734609a4d7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69be1e13e64e84aea1d1d61b9d3d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:41Z,use_quota=True,user_id='b2cb4a657c264c18b11dff575be6a70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8661301f-032c-470e-bded-040a70d80041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8661301f-032c-470e-bded-040a70d80041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ed9574-99dd-4708-a942-e83672e6d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ed9574-99dd-4708-a942-e83672e6d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003a6a51-73d8-4621-ac5c-734609a4d7f5', 'volume_name': 'volume-003a6a51-73d8-4621-ac5c-734609a4d7f5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476e6673-9d41-4d8a-b2c4-b1756af2985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476e6673-9d41-4d8a-b2c4-b1756af2985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1080d058-8e0f-412f-a5b7-e7ceb9a3fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Volume 003a6a51-73d8-4621-ac5c-734609a4d7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003a6a51-73d8-4621-ac5c-734609a4d7f5', 'volume_size': 1} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:40 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 1073741824" returned: 0 in 0.537s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:40 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 Apr 10 16:19:40 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "cinder-quobyte-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5fe985-161c-4ccb-a4c4-2af223c3b61b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:41 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd Apr 10 16:19:41 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:41 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515" returned: 0 in 0.419s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.925s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129018187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22d16c1-b605-4113-96e6-0b5dc44b8c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d5c7eba76f49c9b5d8d5cc91aecbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:31Z,use_quota=True,user_id='844b6df007ca4032b2c60e0bd7d5506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Creating volume b22d16c1-b605-4113-96e6-0b5dc44b8c66 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:41 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:41 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 1073741824 Apr 10 16:19:41 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dc2760-d090-40f4-bf14-aedf334ea4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a3249c-851e-42f7-a612-b84316819499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:41 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Volume volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 (cb5bbf4f-cc9f-4ec5-8481-9fd041a41515): created successfully Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a3249c-851e-42f7-a612-b84316819499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (75b19c72-f008-4dc5-a00a-6f946b50cd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-cff558dd-f612-4978-a641-5af95dc22f67 tempest-CreateVolumesFromImageTest-1824449312 None] Created volume successfully. Apr 10 16:19:41 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" returned: 0 in 0.470s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:41 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd Apr 10 16:19:41 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:41 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 1073741824" returned: 0 in 0.513s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:41 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 Apr 10 16:19:41 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:42 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" returned: 0 in 0.455s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Lock "cinder-quobyte-a9b0d5eb-0d54-4e50-915c-a8f000c6c8cd" released by "delete_volume" :: held 0.965s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Created reservations ['8f55e151-0500-4bbd-a85c-b93237fcfb70'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:42 devstack cinder-volume[82117]: WARNING cinder.quota [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1864453534 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1864453534, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Created reservations ['243e09f2-1a76-4f20-98e4-e75e79b01362', 'edcfc4fd-d50d-4b84-b002-5e49f9f644e0', '50021302-1571-4f32-912c-c9dc319e339b', 'c3418076-e52e-4dd5-96b4-44ff57919f52'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:42 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:42 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:42 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.330s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4449e9-79ba-4e89-ae2c-102db3fb9145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa3f47c-38be-49bc-bcd9-9344b9e10c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Creating offline snapshot 8bb0ee33-ac34-4229-a51b-ec628035118a of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:42 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Volume volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 (b22d16c1-b605-4113-96e6-0b5dc44b8c66): created successfully Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa3f47c-38be-49bc-bcd9-9344b9e10c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Flow 'volume_create_manager' (6cb6b36c-aed3-4821-a093-e30be47f9158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc502c78-c3bc-4d68-840d-96dc643c8b45]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:42 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c4bb8bb0-8dcc-44c2-bbaa-77f8d67e20b3 tempest-CreateVolumesFromImageTest-1824449312 None] Created volume successfully. Apr 10 16:19:42 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:42 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:42 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:42 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-507be9dc-6094-460a-87f6-281a79bcd4a1 tempest-GroupSnapshotsTest-364060987 None] Delete group completed successfully. Apr 10 16:19:42 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.473s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:42 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a 1G Apr 10 16:19:42 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-b22d16c1-b605-4113-96e6-0b5dc44b8c66-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-b22d16c1-b605-4113-96e6-0b5dc44b8c66-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-quobyte-b22d16c1-b605-4113-96e6-0b5dc44b8c66" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-b22d16c1-b605-4113-96e6-0b5dc44b8c66" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6650b9-6566-4418-a9ef-03d1d58f532c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:43 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 Apr 10 16:19:43 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:43 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a 1G" returned: 0 in 0.568s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:43 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a Apr 10 16:19:43 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:43 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:43 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66 Apr 10 16:19:43 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:43 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a" returned: 0 in 0.493s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:43 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a is being set with open permissions: ugo+rw Apr 10 16:19:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:43 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a Apr 10 16:19:43 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:44 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b22d16c1-b605-4113-96e6-0b5dc44b8c66" returned: 0 in 0.516s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-b22d16c1-b605-4113-96e6-0b5dc44b8c66" released by "delete_volume" :: held 1.052s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Created reservations ['db8b9546-7b38-4dda-8c9f-6480a14f338c', '809f8ba9-fbd7-45e4-b522-68ab3f1e7601', '524cbcf8-0362-4740-be2b-bf56ae673874', 'ead55d30-b4f2-4ccb-86de-7ef05ae409b0'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:44 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:44 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:44 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a" returned: 0 in 0.538s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.660s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-722224602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003a6a51-73d8-4621-ac5c-734609a4d7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c69be1e13e64e84aea1d1d61b9d3d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:41Z,use_quota=True,user_id='b2cb4a657c264c18b11dff575be6a70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Creating volume 003a6a51-73d8-4621-ac5c-734609a4d7f5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:44 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:44 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 1073741824 Apr 10 16:19:44 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7f3cab6f-043f-4986-9fcd-8f19d0a9878e tempest-SnapshotsActionsTest-2061706042 None] Create snapshot completed successfully Apr 10 16:19:44 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Deleted volume successfully. Apr 10 16:19:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e243f20-a4a0-4f08-9111-0015adaf9255 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-b22d16c1-b605-4113-96e6-0b5dc44b8c66-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:45 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 1073741824" returned: 0 in 0.573s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:45 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 Apr 10 16:19:45 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-quobyte-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515" acquired by "delete_volume" :: waited 0.022s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-8bb0ee33-ac34-4229-a51b-ec628035118a-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c0119-d147-41b8-a5b0-a083f5cd6ad8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-8bb0ee33-ac34-4229-a51b-ec628035118a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Acquiring lock "cinder-quobyte-8bb0ee33-ac34-4229-a51b-ec628035118a" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-8bb0ee33-ac34-4229-a51b-ec628035118a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Deleting offline snapshot 8bb0ee33-ac34-4229-a51b-ec628035118a of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] snapshot_file for this snap is: volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f9a68-f569-4502-a35f-a552075d5b73]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:45 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 Apr 10 16:19:45 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:45 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a Apr 10 16:19:45 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:45 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5" returned: 0 in 0.486s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1080d058-8e0f-412f-a5b7-e7ceb9a3fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003a6a51-73d8-4621-ac5c-734609a4d7f5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5a63cf-eeb9-468a-a6de-599418096750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:45 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Volume volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 (003a6a51-73d8-4621-ac5c-734609a4d7f5): created successfully Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5a63cf-eeb9-468a-a6de-599418096750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Flow 'volume_create_manager' (98121689-a1ec-4440-867d-e855033d8e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1ece6bd3-3566-468a-b92a-d91c6c3faf3a tempest-VolumesNegativeTest-107720842 None] Created volume successfully. Apr 10 16:19:45 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a" returned: 0 in 0.547s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:45 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515" returned: 0 in 0.639s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb2b4c0-af71-4f27-acde-0020f5d6cf70]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:46 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515 Apr 10 16:19:46 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:46 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:46 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:46 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515" returned: 0 in 0.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515" released by "delete_volume" :: held 1.171s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Created reservations ['0d0097cb-8af4-466c-a6ad-f435d29e5d9e', '9a8b4165-3661-47c2-9337-6b7d74e45d2a', '0178f4fb-c298-4381-9e80-48d2f0838d78', '0023390c-81c3-4388-8272-44d8ca94269c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:46 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:46 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:46 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.676s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:46 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a Apr 10 16:19:46 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:47 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.572s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:47 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Deleted volume successfully. Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5dfc5754-2513-4f19-8bad-99d05f840518 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-cb5bbf4f-cc9f-4ec5-8481-9fd041a41515-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:47 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a" returned: 0 in 0.639s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:47 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a Apr 10 16:19:47 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-c8eddf08-117c-4baa-99fb-db817e7b7f1b-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-c8eddf08-117c-4baa-99fb-db817e7b7f1b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-quobyte-c8eddf08-117c-4baa-99fb-db817e7b7f1b" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-c8eddf08-117c-4baa-99fb-db817e7b7f1b" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3673d42e-e1da-4dd8-9755-8fba123f305e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:47 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b Apr 10 16:19:47 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:47 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.8bb0ee33-ac34-4229-a51b-ec628035118a" returned: 0 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-8bb0ee33-ac34-4229-a51b-ec628035118a" released by "_delete_snapshot" :: held 2.457s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" released by "delete_snapshot" :: held 2.471s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Created reservations ['4d832fe8-8662-4ad9-94b9-49335c90e05c', '983d69c6-d17e-47be-94b2-fc6059c40701', '8fca50ba-161c-4e68-a591-fe79b01d158d', 'ba097e24-359a-40ff-a2d3-f1aba260456b'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:47 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Delete snapshot completed successfully. Apr 10 16:19:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-977e48d3-6fec-4318-b648-a4f1b6f68488 tempest-SnapshotsActionsTest-1820566297 None] Lock "cinder-8bb0ee33-ac34-4229-a51b-ec628035118a-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:48 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b" returned: 0 in 0.559s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:48 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b Apr 10 16:19:48 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:48 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c8eddf08-117c-4baa-99fb-db817e7b7f1b" returned: 0 in 0.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-c8eddf08-117c-4baa-99fb-db817e7b7f1b" released by "delete_volume" :: held 1.082s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Created reservations ['998fba1f-2372-42eb-b414-cb9be948f0b4', '18a98298-c61c-45d8-bdfd-3d7b16bd85c5', 'b217422c-dea7-4be5-a7dd-fdc952a168e3', 'e718394c-06d8-4f34-a985-df0615c9352e'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:48 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:48 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "cinder-d920b543-faee-4e47-9e0b-fbea72e502b0-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-d920b543-faee-4e47-9e0b-fbea72e502b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "cinder-quobyte-d920b543-faee-4e47-9e0b-fbea72e502b0" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-quobyte-d920b543-faee-4e47-9e0b-fbea72e502b0" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Deleting offline snapshot d920b543-faee-4e47-9e0b-fbea72e502b0 of volume b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] snapshot_file for this snap is: volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9adef7-a78e-4431-956d-77f83b12fcac]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:49 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:49 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:49 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Deleted volume successfully. Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b576609-c03d-4e1c-ad08-25c7dcb00e57 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-c8eddf08-117c-4baa-99fb-db817e7b7f1b-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:49 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.585s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d7244-046c-4f57-a6e9-03d877c4210d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:49 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 Apr 10 16:19:49 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-ae15db84-bf05-4982-94c3-9b725c2b2258-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-ae15db84-bf05-4982-94c3-9b725c2b2258-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-quobyte-ae15db84-bf05-4982-94c3-9b725c2b2258" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-ae15db84-bf05-4982-94c3-9b725c2b2258" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2afeb1-98b8-409f-a6c4-f24f61b28829]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:49 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 Apr 10 16:19:49 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:50 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5" returned: 0 in 0.552s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:50 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:50 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:50 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258" returned: 0 in 0.586s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:50 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258 Apr 10 16:19:50 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:50 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Flow 'volume_create_manager' (62fbb5c0-45da-49eb-ad81-7ce57c39ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8eab1d-0e2f-4a89-bff4-9d48f2100323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.551s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:50 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0 Apr 10 16:19:50 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8eab1d-0e2f-4a89-bff4-9d48f2100323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2049536419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6898c4b9-fde6-44d1-83bf-19e5975d9af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db68b725fc24c31bc9f7772eda74f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:51Z,use_quota=True,user_id='6c1cb60108dc416ba761f1f1515a0bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b813d7c-a294-40fc-a1ca-4f7bcde20995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b813d7c-a294-40fc-a1ca-4f7bcde20995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0fb21c-c03c-43ec-af90-97a7d48a9c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0fb21c-c03c-43ec-af90-97a7d48a9c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6898c4b9-fde6-44d1-83bf-19e5975d9af4', 'volume_name': 'volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feaf49ac-d96f-4beb-88f4-018cb9c9dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feaf49ac-d96f-4beb-88f4-018cb9c9dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a16988a-9c56-4b08-9564-f03afe472755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:50 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Volume 6898c4b9-fde6-44d1-83bf-19e5975d9af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4', 'volume_size': 1} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2049536419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6898c4b9-fde6-44d1-83bf-19e5975d9af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db68b725fc24c31bc9f7772eda74f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:51Z,use_quota=True,user_id='6c1cb60108dc416ba761f1f1515a0bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Creating volume 6898c4b9-fde6-44d1-83bf-19e5975d9af4 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:50 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:50 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 1073741824 Apr 10 16:19:50 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:50 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ae15db84-bf05-4982-94c3-9b725c2b2258" returned: 0 in 0.505s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-ae15db84-bf05-4982-94c3-9b725c2b2258" released by "delete_volume" :: held 1.118s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=159,cinder:UPDATE=176,cinder:DELETE=11,cinder:INSERT=42 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Created reservations ['b658f96e-b31c-423f-9401-1cde0437aba2', 'f8724757-61db-4372-b279-75ce08944d2d', '2d1049e3-35b6-48a9-adc2-d3f3ae820094', '2425538a-15a8-492a-9aa4-dc1530e3588f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:50 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:50 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:51 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5.d920b543-faee-4e47-9e0b-fbea72e502b0" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-quobyte-d920b543-faee-4e47-9e0b-fbea72e502b0" released by "_delete_snapshot" :: held 2.275s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" released by "delete_snapshot" :: held 2.285s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Created reservations ['3cdb422f-1054-4218-8374-9d05cdf062e5', '84e10e83-8ee3-44f3-8a7a-5abf51aa9a2e', 'bdd9e38e-6cfc-4028-b4c4-497930c366e7', 'd469b57c-d638-41ac-9a64-3877272d7dfb'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:51 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 1073741824" returned: 0 in 0.565s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:51 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Delete snapshot completed successfully. Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a7bbf2de-87eb-472a-b201-0619a9494832 tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-d920b543-faee-4e47-9e0b-fbea72e502b0-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:51 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 Apr 10 16:19:51 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:51 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:51 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Deleted volume successfully. Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6bfa5a92-d135-4fbb-81f2-a5b1b4cc26e7 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-ae15db84-bf05-4982-94c3-9b725c2b2258-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:51 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4" returned: 0 in 0.490s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a16988a-9c56-4b08-9564-f03afe472755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8423e66-6996-44c3-9f7a-26211acded9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:51 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Volume volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 (6898c4b9-fde6-44d1-83bf-19e5975d9af4): created successfully Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8423e66-6996-44c3-9f7a-26211acded9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Flow 'volume_create_manager' (62fbb5c0-45da-49eb-ad81-7ce57c39ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:51 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-871ab8cb-4062-4952-9340-e1b540a401f9 tempest-VolumeQuotasNegativeTestJSON-819479133 None] Created volume successfully. Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-c03e0b9b-6afb-4701-8512-b42330b6efb3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-c03e0b9b-6afb-4701-8512-b42330b6efb3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "cinder-quobyte-c03e0b9b-6afb-4701-8512-b42330b6efb3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-c03e0b9b-6afb-4701-8512-b42330b6efb3" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4977ada-3aec-47c6-a900-91b78a4a5e43]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:52 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 Apr 10 16:19:52 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "cinder-b3b6f335-06ae-4c73-835c-a8e1088f44b5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-b3b6f335-06ae-4c73-835c-a8e1088f44b5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[211169bd-0960-4f61-bcba-73b16bf78e79]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:52 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 Apr 10 16:19:52 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:52 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3" returned: 0 in 0.587s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:52 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3 Apr 10 16:19:52 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:52 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:52 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5 Apr 10 16:19:52 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:53 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c03e0b9b-6afb-4701-8512-b42330b6efb3" returned: 0 in 0.653s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-quobyte-c03e0b9b-6afb-4701-8512-b42330b6efb3" released by "delete_volume" :: held 1.266s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Created reservations ['44dfb9f8-80cf-4e6e-b852-2c269746a3ee', 'b0ed29ea-46e5-4fde-a5ec-2e3ac90b2f9b', '01238bdf-f411-45a9-b8fe-521cbe0edeb9', 'ce0f3903-51d3-4a61-9d6d-43216bbc8765'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:53 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:53 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:53 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3b6f335-06ae-4c73-835c-a8e1088f44b5" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-quobyte-b3b6f335-06ae-4c73-835c-a8e1088f44b5" released by "delete_volume" :: held 1.119s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Created reservations ['9fac326c-020b-48f6-9a37-06659433d06c', '7c016bda-5aa4-451e-9d34-b52daedfb5c8', '3d006854-af1c-4a37-a793-ff6e688f59e9', '69951e3b-fae5-4e9e-92bb-b241bbe2dd50'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:53 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:53 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Acquiring lock "cinder-6898c4b9-fde6-44d1-83bf-19e5975d9af4-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "cinder-6898c4b9-fde6-44d1-83bf-19e5975d9af4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Acquiring lock "cinder-quobyte-6898c4b9-fde6-44d1-83bf-19e5975d9af4" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "cinder-quobyte-6898c4b9-fde6-44d1-83bf-19e5975d9af4" acquired by "delete_volume" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2182e5-e1cc-492a-9e22-6e466d1241cf]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:53 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 Apr 10 16:19:53 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:53 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Deleted volume successfully. Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c28b0acc-fb07-414a-8d53-7335436a0755 tempest-CreateVolumesFromImageTest-1824449312 None] Lock "cinder-c03e0b9b-6afb-4701-8512-b42330b6efb3-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:53 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Deleted volume successfully. Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=221,cinder:SELECT=193,cinder:INSERT=56,cinder:DELETE=14 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:19:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-edd35f7f-2fb8-4b1b-9740-992dc007c76b tempest-SnapshotsActionsTest-2061706042 None] Lock "cinder-b3b6f335-06ae-4c73-835c-a8e1088f44b5-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:54 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4" returned: 0 in 0.569s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:54 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4 Apr 10 16:19:54 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:54 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6898c4b9-fde6-44d1-83bf-19e5975d9af4" returned: 0 in 0.541s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "cinder-quobyte-6898c4b9-fde6-44d1-83bf-19e5975d9af4" released by "delete_volume" :: held 1.137s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Created reservations ['1caddc4e-cf99-413c-a9e0-437d047fc01c', '0cbd79e0-31f4-4a98-bc55-b8f19fe1d6ae', 'f85e644d-c937-48fa-941b-9beefe1732c8', '6a7fae22-40ef-4731-a881-1de917094ed2'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:54 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:19:54 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:55 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.594s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:55 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:19:55 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Deleted volume successfully. Apr 10 16:19:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9d2e3e33-cd6c-4967-b046-3c238900ecff tempest-VolumeQuotasNegativeTestJSON-819479133 None] Lock "cinder-6898c4b9-fde6-44d1-83bf-19e5975d9af4-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (e8921af4-6553-4b8b-9109-fb42eae334c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8caba36-191d-45b9-9ec8-ec840f8a4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8caba36-191d-45b9-9ec8-ec840f8a4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-697393068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9acfbb-c006-4702-b852-2101e927e977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:56Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2905c6e2-8b2d-4034-8d89-4ac4ee1280f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2905c6e2-8b2d-4034-8d89-4ac4ee1280f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f53cc6-2cbc-4b62-bf1a-b67cff507f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f53cc6-2cbc-4b62-bf1a-b67cff507f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9acfbb-c006-4702-b852-2101e927e977', 'volume_name': 'volume-2f9acfbb-c006-4702-b852-2101e927e977', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669d6a70-64d3-4adb-aedb-01c1c0f9e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669d6a70-64d3-4adb-aedb-01c1c0f9e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2231b6-a20a-4efc-bbcc-fb40f5392238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume 2f9acfbb-c006-4702-b852-2101e927e977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9acfbb-c006-4702-b852-2101e927e977', 'volume_size': 1} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-697393068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9acfbb-c006-4702-b852-2101e927e977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:56Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating volume 2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:56 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:56 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 1073741824 Apr 10 16:19:56 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:56 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 1073741824" returned: 0 in 0.588s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:56 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 Apr 10 16:19:56 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:57 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977" returned: 0 in 0.472s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2231b6-a20a-4efc-bbcc-fb40f5392238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9acfbb-c006-4702-b852-2101e927e977', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cde8ac-7134-49ad-893a-59b79b5ceb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:57 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume volume-2f9acfbb-c006-4702-b852-2101e927e977 (2f9acfbb-c006-4702-b852-2101e927e977): created successfully Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cde8ac-7134-49ad-893a-59b79b5ceb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (e8921af4-6553-4b8b-9109-fb42eae334c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-85f4ac31-5663-453c-b505-6bf6c6ab233d tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created volume successfully. Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Flow 'volume_create_manager' (26c284b8-be6a-49a4-a43d-bba19c3ffcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be117258-2e17-4790-ad88-7771dacf6b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be117258-2e17-4790-ad88-7771dacf6b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1245417648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943e28a8-a29b-4d38-8b8d-ed454d3718f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569cecdaef4a4ca6a5c490c7b75ebda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:58Z,use_quota=True,user_id='c58be0de158145789120053fc918c8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49258502-a20b-4bd2-9147-41dafd10af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49258502-a20b-4bd2-9147-41dafd10af42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fec467-3388-4b0c-b769-8d62160b3df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fec467-3388-4b0c-b769-8d62160b3df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943e28a8-a29b-4d38-8b8d-ed454d3718f9', 'volume_name': 'volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c94f56-d32f-431b-9875-0f078076ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c94f56-d32f-431b-9875-0f078076ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e2edb3-2951-4603-94e5-7e345701c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:58 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Volume 943e28a8-a29b-4d38-8b8d-ed454d3718f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9', 'volume_size': 1} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1245417648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943e28a8-a29b-4d38-8b8d-ed454d3718f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569cecdaef4a4ca6a5c490c7b75ebda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:19:58Z,use_quota=True,user_id='c58be0de158145789120053fc918c8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Creating volume 943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:19:58 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:58 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 1073741824 Apr 10 16:19:58 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:19:58 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 1073741824" returned: 0 in 0.867s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:59 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 Apr 10 16:19:59 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:19:59 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9" returned: 0 in 0.562s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.832s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e2edb3-2951-4603-94e5-7e345701c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e500bf1f-62ed-4aee-ae2b-6106ce3e12df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating offline snapshot 49d1aaba-348d-408e-b56e-90e501b0c638 of volume 2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:19:59 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Volume volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 (943e28a8-a29b-4d38-8b8d-ed454d3718f9): created successfully Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e500bf1f-62ed-4aee-ae2b-6106ce3e12df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Flow 'volume_create_manager' (26c284b8-be6a-49a4-a43d-bba19c3ffcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e99fc0-0ed7-450e-9172-9b44466d7d0c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:19:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:19:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-404a203f-6159-4588-99e8-f1041abca127 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Created volume successfully. Apr 10 16:19:59 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 Apr 10 16:19:59 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:00 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977" returned: 0 in 0.766s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:00 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 1G Apr 10 16:20:00 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:01 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 1G" returned: 0 in 0.630s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9acfbb-c006-4702-b852-2101e927e977 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:01 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9acfbb-c006-4702-b852-2101e927e977 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 Apr 10 16:20:01 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:01 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9acfbb-c006-4702-b852-2101e927e977 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638" returned: 0 in 0.478s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:01 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 is being set with open permissions: ugo+rw Apr 10 16:20:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:01 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 Apr 10 16:20:01 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:02 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:02 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info Apr 10 16:20:02 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:02 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info" returned: 0 in 0.468s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:02 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info is being set with open permissions: ugo+rw Apr 10 16:20:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:02 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info Apr 10 16:20:02 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:03 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.info" returned: 0 in 0.530s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.515s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.756s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Creating offline snapshot 5a3e2297-3cc8-43e7-970e-a95e99ce42b5 of volume 943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:20:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c38b6569-827c-4e81-9511-c766c34c8b78 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Create snapshot completed successfully Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05c63a1-98eb-4330-a77b-2e9c7e8fb0ae]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:03 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 Apr 10 16:20:03 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:03 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9" returned: 0 in 0.526s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:03 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 1G Apr 10 16:20:03 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Flow 'volume_create_manager' (e2eb5b3e-e470-4689-a7d0-9d9e5dfc686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263e8c26-5e3d-47ad-b25c-8bd8a675bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263e8c26-5e3d-47ad-b25c-8bd8a675bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-774991817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccbb0022c754b48b4a7bd8c3a91ca21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:04Z,use_quota=True,user_id='720de7120c424a1cbd1eb9917711c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a02b2b01-c520-4b9f-92b0-53b1bd41affe),volume_type_id=a02b2b01-c520-4b9f-92b0-53b1bd41affe)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228a914e-522c-48d6-8d31-d748e04b0530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228a914e-522c-48d6-8d31-d748e04b0530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c5461c-524c-4973-b466-30d2bee50120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c5461c-524c-4973-b466-30d2bee50120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5', 'volume_name': 'volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6a77ee-8ec5-4101-bfd1-ca33c2848741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6a77ee-8ec5-4101-bfd1-ca33c2848741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376ecf81-86e2-48fb-ae74-bdc172cf28a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:03 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Volume f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5', 'volume_size': 1} Apr 10 16:20:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (61441b26-81ea-4ff3-97f7-a1348e4ab7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de821542-1561-4655-9739-bc54eecd313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de821542-1561-4655-9739-bc54eecd313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12765905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc15272-20d9-42d0-ad23-e5021aa91a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:04Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cbbf5c-e2e0-458a-b028-cbe702707752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cbbf5c-e2e0-458a-b028-cbe702707752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cfff3d-f212-471f-892e-11cd6e776a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cfff3d-f212-471f-892e-11cd6e776a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc15272-20d9-42d0-ad23-e5021aa91a50', 'volume_name': 'volume-ccc15272-20d9-42d0-ad23-e5021aa91a50', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3967a9-f4b3-4a77-9706-4d34e1d638ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3967a9-f4b3-4a77-9706-4d34e1d638ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc33480-540a-4151-bff2-99469199a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume ccc15272-20d9-42d0-ad23-e5021aa91a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc15272-20d9-42d0-ad23-e5021aa91a50', 'volume_size': 1} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 1G" returned: 0 in 0.577s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:04 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 Apr 10 16:20:04 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (fe81f67e-c11d-485d-ae19-99bf9611c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23d4842-867a-41c6-881d-ea7bfc3bdfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23d4842-867a-41c6-881d-ea7bfc3bdfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419448372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5104a10c-82da-454a-b9c0-ef617c5d6e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:04Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6756422e-e07e-41f5-a51b-e3d8db3d060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6756422e-e07e-41f5-a51b-e3d8db3d060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a098c7-7573-477d-b947-7f543f56970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a098c7-7573-477d-b947-7f543f56970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5104a10c-82da-454a-b9c0-ef617c5d6e9d', 'volume_name': 'volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba2d19e-23cb-4ed9-9b67-e8e31ee41354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba2d19e-23cb-4ed9-9b67-e8e31ee41354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3734d5a-7839-43d4-ad26-ec59e35a4873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume 5104a10c-82da-454a-b9c0-ef617c5d6e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d', 'volume_size': 1} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (a2fe401d-5742-4f82-8953-7a212bc6517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51395a91-05a7-440a-b898-18dfc3abb1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51395a91-05a7-440a-b898-18dfc3abb1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205938249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f5eb00-bcce-4707-9902-746acbc7ff28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:05Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f761f1-4dc6-48b3-b261-2bb230122fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f761f1-4dc6-48b3-b261-2bb230122fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac238ca7-d118-4d09-a128-438d0f2b83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac238ca7-d118-4d09-a128-438d0f2b83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f5eb00-bcce-4707-9902-746acbc7ff28', 'volume_name': 'volume-b1f5eb00-bcce-4707-9902-746acbc7ff28', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af3851a-32d5-49a9-a6a3-178c05426a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af3851a-32d5-49a9-a6a3-178c05426a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e96ebbc-5eda-4ebb-af8e-2178595f5c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume b1f5eb00-bcce-4707-9902-746acbc7ff28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f5eb00-bcce-4707-9902-746acbc7ff28', 'volume_size': 1} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:04 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5" returned: 0 in 0.591s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:04 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 is being set with open permissions: ugo+rw Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:04 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 Apr 10 16:20:04 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (3a8d188d-1dae-4f60-bcd7-2b7fa023b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c54c01d-54da-4c54-ac90-2ded825792c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c54c01d-54da-4c54-ac90-2ded825792c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861786672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7414269e-42e6-4fbd-8ea8-cc1af56af2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:05Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da07453f-eebe-4106-b8db-b9222c567b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da07453f-eebe-4106-b8db-b9222c567b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc4769-3926-40a7-b165-11b818d8323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc4769-3926-40a7-b165-11b818d8323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7414269e-42e6-4fbd-8ea8-cc1af56af2cd', 'volume_name': 'volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4a7ec-f12f-4cb2-a2b9-138fd5d6a8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4a7ec-f12f-4cb2-a2b9-138fd5d6a8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eca0940-37fe-41ed-8f16-b28767fb018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume 7414269e-42e6-4fbd-8ea8-cc1af56af2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd', 'volume_size': 1} Apr 10 16:20:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (aa9f994e-27f4-4f45-b70d-dac615855a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea700f3-551b-4e62-b8e8-c28853b2803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea700f3-551b-4e62-b8e8-c28853b2803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398207764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6768c4-cb0e-4f35-9564-f64176925a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:05Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18e2003-e22c-4d6f-93c6-0e3b33838572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18e2003-e22c-4d6f-93c6-0e3b33838572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7afa067-2c04-4962-a0ea-0bfc01cd81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7afa067-2c04-4962-a0ea-0bfc01cd81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6768c4-cb0e-4f35-9564-f64176925a6c', 'volume_name': 'volume-ca6768c4-cb0e-4f35-9564-f64176925a6c', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6e9cf3-d9cb-47b2-b201-80e71d8a3d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6e9cf3-d9cb-47b2-b201-80e71d8a3d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecc40d8-c3fb-4ba4-883e-4732e30d6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume ca6768c4-cb0e-4f35-9564-f64176925a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6768c4-cb0e-4f35-9564-f64176925a6c', 'volume_size': 1} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:05 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:05 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info Apr 10 16:20:05 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:05 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:05 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info is being set with open permissions: ugo+rw Apr 10 16:20:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:05 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info Apr 10 16:20:05 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:06 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.info" returned: 0 in 0.443s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.116s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.422s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-774991817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccbb0022c754b48b4a7bd8c3a91ca21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:04Z,use_quota=True,user_id='720de7120c424a1cbd1eb9917711c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a02b2b01-c520-4b9f-92b0-53b1bd41affe),volume_type_id=a02b2b01-c520-4b9f-92b0-53b1bd41affe)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Creating volume f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:06 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:06 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 1073741824 Apr 10 16:20:06 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d22e84f7-38aa-4804-b41c-c725cc3cbb86 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Create snapshot completed successfully Apr 10 16:20:06 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 1073741824" returned: 0 in 0.564s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:06 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 Apr 10 16:20:06 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "cinder-5a3e2297-3cc8-43e7-970e-a95e99ce42b5-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-5a3e2297-3cc8-43e7-970e-a95e99ce42b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "cinder-quobyte-943e28a8-a29b-4d38-8b8d-ed454d3718f9" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-quobyte-943e28a8-a29b-4d38-8b8d-ed454d3718f9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "cinder-quobyte-5a3e2297-3cc8-43e7-970e-a95e99ce42b5" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-quobyte-5a3e2297-3cc8-43e7-970e-a95e99ce42b5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Deleting offline snapshot 5a3e2297-3cc8-43e7-970e-a95e99ce42b5 of volume 943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] snapshot_file for this snap is: volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb76a01-8339-4596-890d-ed8ebba385f7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:07 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 Apr 10 16:20:07 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:07 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5" returned: 0 in 0.522s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.117s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12765905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc15272-20d9-42d0-ad23-e5021aa91a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:04Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating volume ccc15272-20d9-42d0-ad23-e5021aa91a50 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:07 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376ecf81-86e2-48fb-ae74-bdc172cf28a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125e23c1-9c0a-4ea7-a18c-ec9cff27b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:07 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 1073741824 Apr 10 16:20:07 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:07 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Volume volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 (f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5): created successfully Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125e23c1-9c0a-4ea7-a18c-ec9cff27b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Flow 'volume_create_manager' (e2eb5b3e-e470-4689-a7d0-9d9e5dfc686b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:07 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-cf32505a-2b96-4d7d-b11d-4b994cfcb659 tempest-VolumeTypesAccessTest-1248281373 None] Created volume successfully. Apr 10 16:20:07 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5" returned: 0 in 0.596s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[00919148-9c23-415a-b3b8-f28df56a7359]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:07 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 Apr 10 16:20:07 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:07 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 1073741824" returned: 0 in 0.629s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Acquiring lock "cinder-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:08 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 Apr 10 16:20:08 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Lock "cinder-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Acquiring lock "cinder-quobyte-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Lock "cinder-quobyte-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bde518-c6f0-43c7-9b6e-dff440a31493]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:08 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 Apr 10 16:20:08 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:08 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9" returned: 0 in 0.661s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:08 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 Apr 10 16:20:08 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:08 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.063s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419448372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5104a10c-82da-454a-b9c0-ef617c5d6e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:04Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating volume 5104a10c-82da-454a-b9c0-ef617c5d6e9d {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:08 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc33480-540a-4151-bff2-99469199a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc15272-20d9-42d0-ad23-e5021aa91a50', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949ad212-4bf2-4ebe-bcf9-bbdf949a8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:08 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 (ccc15272-20d9-42d0-ad23-e5021aa91a50): created successfully Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949ad212-4bf2-4ebe-bcf9-bbdf949a8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (61441b26-81ea-4ff3-97f7-a1348e4ab7af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:08 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1da59c8c-547a-46d4-8dda-af5f269e46be tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created volume successfully. Apr 10 16:20:08 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d 1073741824 Apr 10 16:20:08 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:08 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5" returned: 0 in 0.571s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:08 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5 Apr 10 16:20:08 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:08 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5" returned: 0 in 0.558s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:08 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5 Apr 10 16:20:08 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:09 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:09 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d 1073741824" returned: 0 in 0.704s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Lock "cinder-quobyte-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5" released by "delete_volume" :: held 1.120s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:09 devstack cinder-volume[82117]: WARNING cinder.quota [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-907020216 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-907020216, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:20:09 devstack cinder-volume[82117]: WARNING cinder.quota [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-907020216 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-907020216, it is now deprecated. Please use the default quota class for default quota. Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Created reservations ['884e33e7-87de-475f-b799-c249a95b7227', 'cdb5c6f0-218d-4555-926d-162ecd1667f8', 'd565e4a6-7927-49b4-b242-9361c41ca61d', 'c499aa4b-e078-4ee8-9005-9b9d7311fa1d'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:09 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:09 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:09 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9.5a3e2297-3cc8-43e7-970e-a95e99ce42b5" returned: 0 in 0.553s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:09 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d Apr 10 16:20:09 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-quobyte-5a3e2297-3cc8-43e7-970e-a95e99ce42b5" released by "_delete_snapshot" :: held 2.443s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-quobyte-943e28a8-a29b-4d38-8b8d-ed454d3718f9" released by "delete_snapshot" :: held 2.456s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Created reservations ['5cf7e6b2-96ac-4a2d-8f08-337edddcbcd9', 'bc0ae7ea-fe3e-4340-bece-b573e881b46a', '87bc9e56-3c3d-44a9-bf9c-2d5355edaa2f', '2dc58bdb-3ce8-46bc-b6ba-6105024f536e'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Delete snapshot completed successfully. Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6b66541f-1fdf-423e-8165-811cd4b73703 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-5a3e2297-3cc8-43e7-970e-a95e99ce42b5-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:09 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:09 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.157s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205938249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f5eb00-bcce-4707-9902-746acbc7ff28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:05Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating volume b1f5eb00-bcce-4707-9902-746acbc7ff28 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:09 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3734d5a-7839-43d4-ad26-ec59e35a4873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345ddcb0-aba5-4db2-bf91-3251c5f331f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:09 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 1073741824 Apr 10 16:20:09 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.497s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Deleted volume successfully. Apr 10 16:20:09 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d (5104a10c-82da-454a-b9c0-ef617c5d6e9d): created successfully Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345ddcb0-aba5-4db2-bf91-3251c5f331f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (fe81f67e-c11d-485d-ae19-99bf9611c304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ed32d07d-23e4-403b-b118-c5d1811900f2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created volume successfully. Apr 10 16:20:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d9c3d475-6d8c-4f80-bf69-a5051f9384b6 tempest-VolumeTypesAccessTest-1248281373 None] Lock "cinder-f04ca9fd-1343-4468-8a3a-f0e1b67c6ed5-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "cinder-943e28a8-a29b-4d38-8b8d-ed454d3718f9-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-943e28a8-a29b-4d38-8b8d-ed454d3718f9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "cinder-quobyte-943e28a8-a29b-4d38-8b8d-ed454d3718f9" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-quobyte-943e28a8-a29b-4d38-8b8d-ed454d3718f9" acquired by "delete_volume" :: waited 0.021s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b34731-ff1c-411f-8cbf-990225398514]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:10 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 Apr 10 16:20:10 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:10 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 1073741824" returned: 0 in 0.653s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:10 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 Apr 10 16:20:10 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:10 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9" returned: 0 in 0.687s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:10 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9 Apr 10 16:20:10 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:10 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28" returned: 0 in 0.484s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.098s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861786672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7414269e-42e6-4fbd-8ea8-cc1af56af2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:05Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating volume 7414269e-42e6-4fbd-8ea8-cc1af56af2cd {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:11 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Acquiring lock "cinder-003a6a51-73d8-4621-ac5c-734609a4d7f5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e96ebbc-5eda-4ebb-af8e-2178595f5c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f5eb00-bcce-4707-9902-746acbc7ff28', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e466e31b-ea07-46f7-a73e-15c0e0ece9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:11 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd 1073741824 Apr 10 16:20:11 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:11 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 (b1f5eb00-bcce-4707-9902-746acbc7ff28): created successfully Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e466e31b-ea07-46f7-a73e-15c0e0ece9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (a2fe401d-5742-4f82-8953-7a212bc6517b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Lock "cinder-003a6a51-73d8-4621-ac5c-734609a4d7f5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Acquiring lock "cinder-quobyte-003a6a51-73d8-4621-ac5c-734609a4d7f5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-95c1dd43-553a-4f13-9f12-97d6605240c2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created volume successfully. Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Lock "cinder-quobyte-003a6a51-73d8-4621-ac5c-734609a4d7f5" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e11feb-50ac-490d-8692-3dfdca880020]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:11 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 Apr 10 16:20:11 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:11 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-943e28a8-a29b-4d38-8b8d-ed454d3718f9" returned: 0 in 0.519s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-quobyte-943e28a8-a29b-4d38-8b8d-ed454d3718f9" released by "delete_volume" :: held 1.245s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Created reservations ['d15e8c74-4609-4e26-aff3-9964452937bb', '266dbbd9-ae2e-4b5e-b131-69ee11b55e50', '0b815e57-9818-4c8e-b9a7-7714198b8d0e', '7cfa027b-696b-420a-bdd8-be5d76a39e89'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:11 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:11 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:11 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd 1073741824" returned: 0 in 0.763s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:11 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd Apr 10 16:20:11 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:11 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5" returned: 0 in 0.737s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:11 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5 Apr 10 16:20:11 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:12 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.507s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Deleted volume successfully. Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0a05571f-49f2-40d5-98fe-9b656eaefd27 tempest-VolumeSnapshotQuotasNegativeTestJSON-996714488 None] Lock "cinder-943e28a8-a29b-4d38-8b8d-ed454d3718f9-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:12 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd" returned: 0 in 0.491s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.192s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398207764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6768c4-cb0e-4f35-9564-f64176925a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd3d2a1f98340d0b2ad48780eabd3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:05Z,use_quota=True,user_id='87787dfe45c64963a41e6fd3309f6779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Creating volume ca6768c4-cb0e-4f35-9564-f64176925a6c {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:12 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eca0940-37fe-41ed-8f16-b28767fb018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aba5c5-eda6-420a-8504-81a10259bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:12 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c 1073741824 Apr 10 16:20:12 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:12 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd (7414269e-42e6-4fbd-8ea8-cc1af56af2cd): created successfully Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aba5c5-eda6-420a-8504-81a10259bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (3a8d188d-1dae-4f60-bcd7-2b7fa023b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c0b8c92b-491e-4537-a93c-e2cd10a723b2 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created volume successfully. Apr 10 16:20:12 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-003a6a51-73d8-4621-ac5c-734609a4d7f5" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Lock "cinder-quobyte-003a6a51-73d8-4621-ac5c-734609a4d7f5" released by "delete_volume" :: held 1.288s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Created reservations ['2aa39969-4adb-4636-8cb4-b051a840b8c4', '846cbe56-198b-4353-bb6b-b1d30c549639', 'c79362e6-1e95-45be-9f05-723c7efb07f6', '16fcf783-6110-48ce-aff4-23434c1cfb07'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:12 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:12 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:12 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c 1073741824" returned: 0 in 0.658s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:13 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.513s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:13 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c Apr 10 16:20:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Deleted volume successfully. Apr 10 16:20:13 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-840117a8-b5ca-4123-8ee1-8173db6c1275 tempest-VolumesNegativeTest-107720842 None] Lock "cinder-003a6a51-73d8-4621-ac5c-734609a4d7f5-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:13 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c" returned: 0 in 0.524s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecc40d8-c3fb-4ba4-883e-4732e30d6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6768c4-cb0e-4f35-9564-f64176925a6c', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386c7f00-28c8-417f-bd9a-1fff7b312119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:13 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Volume volume-ca6768c4-cb0e-4f35-9564-f64176925a6c (ca6768c4-cb0e-4f35-9564-f64176925a6c): created successfully Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386c7f00-28c8-417f-bd9a-1fff7b312119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Flow 'volume_create_manager' (aa9f994e-27f4-4f45-b70d-dac615855a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1f0de578-e493-4ba8-bfeb-45a228577e9c tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created volume successfully. Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-ca6768c4-cb0e-4f35-9564-f64176925a6c-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-ca6768c4-cb0e-4f35-9564-f64176925a6c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-ca6768c4-cb0e-4f35-9564-f64176925a6c" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-ca6768c4-cb0e-4f35-9564-f64176925a6c" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:14 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee0f8d2-e876-4652-ab83-c107e0f2759c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:14 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c Apr 10 16:20:14 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:14 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c" returned: 0 in 0.594s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:14 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c Apr 10 16:20:14 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:15 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ca6768c4-cb0e-4f35-9564-f64176925a6c" returned: 0 in 0.498s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-ca6768c4-cb0e-4f35-9564-f64176925a6c" released by "delete_volume" :: held 1.117s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['af07e521-bf92-424e-8859-5cf6b15af904', '377fb0c4-28b9-444e-819b-78ebe1767a8f', '6500875d-bd68-439f-a2e8-46d94c6e2ead', 'f4ed8533-5afc-4456-9f27-43798225b6cd'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:15 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:15 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:15 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:15 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:15 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleted volume successfully. Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-63bbddc1-b61e-47f6-8569-dab12a71168f tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-ca6768c4-cb0e-4f35-9564-f64176925a6c-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Flow 'volume_create_manager' (eb3d41be-6f67-4de6-b4ec-c52c9338076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77da59a6-089c-4631-bb2e-117bfe16b076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77da59a6-089c-4631-bb2e-117bfe16b076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-465522407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55afb67-bd19-460f-b0a2-dfc382166a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127ba5c9b74e4daa804258ed9b0f815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:16Z,use_quota=True,user_id='44cc4e7557084d01bf735f8e468d8a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22782fc-57eb-409f-b7bd-85da0b1fbf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22782fc-57eb-409f-b7bd-85da0b1fbf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95be5a4b-9c97-400a-80f7-6311ae20d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95be5a4b-9c97-400a-80f7-6311ae20d649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55afb67-bd19-460f-b0a2-dfc382166a1d', 'volume_name': 'volume-b55afb67-bd19-460f-b0a2-dfc382166a1d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8249cef4-0380-4929-ae9a-ef34a4a08c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8249cef4-0380-4929-ae9a-ef34a4a08c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99be113a-dc77-4f22-92d0-c6eb11e955f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:15 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Volume b55afb67-bd19-460f-b0a2-dfc382166a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55afb67-bd19-460f-b0a2-dfc382166a1d', 'volume_size': 1} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-465522407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55afb67-bd19-460f-b0a2-dfc382166a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127ba5c9b74e4daa804258ed9b0f815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:16Z,use_quota=True,user_id='44cc4e7557084d01bf735f8e468d8a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Creating volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:15 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:15 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d 1073741824 Apr 10 16:20:15 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:16 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.648s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-7414269e-42e6-4fbd-8ea8-cc1af56af2cd-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-7414269e-42e6-4fbd-8ea8-cc1af56af2cd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-7414269e-42e6-4fbd-8ea8-cc1af56af2cd" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-7414269e-42e6-4fbd-8ea8-cc1af56af2cd" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebcf191-4f14-47a1-b393-39f7cf51f4c9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:16 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd Apr 10 16:20:16 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:16 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d 1073741824" returned: 0 in 0.727s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:16 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d Apr 10 16:20:16 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:16 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd" returned: 0 in 0.653s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:16 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd Apr 10 16:20:16 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:17 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d" returned: 0 in 0.489s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99be113a-dc77-4f22-92d0-c6eb11e955f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55afb67-bd19-460f-b0a2-dfc382166a1d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83351a0-1f59-48f7-b1ec-986db5d729de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Volume volume-b55afb67-bd19-460f-b0a2-dfc382166a1d (b55afb67-bd19-460f-b0a2-dfc382166a1d): created successfully Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83351a0-1f59-48f7-b1ec-986db5d729de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Flow 'volume_create_manager' (eb3d41be-6f67-4de6-b4ec-c52c9338076e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:17 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a2e97417-fd7e-4ad8-9cab-da26ab6d8aa2 tempest-VolumesSnapshotListTestJSON-1010337809 None] Created volume successfully. Apr 10 16:20:17 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7414269e-42e6-4fbd-8ea8-cc1af56af2cd" returned: 0 in 0.494s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-7414269e-42e6-4fbd-8ea8-cc1af56af2cd" released by "delete_volume" :: held 1.193s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['9d73fefc-7c58-434e-b27d-4cec476b012b', 'bbfcc9f3-0b2b-42d2-9089-7c666a772780', '607872e6-ba19-48c0-be96-35937f6a2a05', 'e01eb5f5-b9ca-4b94-a7a2-d01d9e38f7d7'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:17 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:17 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:17 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.560s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:18 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleted volume successfully. Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d43d4839-c089-43c6-a785-f3bcc52672d9 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-7414269e-42e6-4fbd-8ea8-cc1af56af2cd-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Creating offline snapshot 84659d6a-9e88-42b2-a398-fa7d8fc3ea4a of volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ed7fc-4e9b-4b22-b46a-fd0f111959fd]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:18 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d Apr 10 16:20:18 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-b1f5eb00-bcce-4707-9902-746acbc7ff28-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-b1f5eb00-bcce-4707-9902-746acbc7ff28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-b1f5eb00-bcce-4707-9902-746acbc7ff28" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-b1f5eb00-bcce-4707-9902-746acbc7ff28" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec6e461-ad8e-48ff-9938-0ef5859830d6]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:18 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 Apr 10 16:20:18 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:18 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d" returned: 0 in 0.671s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:18 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a 1G Apr 10 16:20:18 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:19 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28" returned: 0 in 0.649s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:19 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28 Apr 10 16:20:19 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:19 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a 1G" returned: 0 in 0.677s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:19 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:19 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:19 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b1f5eb00-bcce-4707-9902-746acbc7ff28" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-b1f5eb00-bcce-4707-9902-746acbc7ff28" released by "delete_volume" :: held 1.191s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['231a07f9-a97b-4512-92a9-e8939e7b67a6', '7d5d7b63-7ffa-45ac-92f8-efdc4fc0d391', 'f064855a-fe7d-48c6-a422-0ae8cb6b0265', 'ad00fff6-9561-42e2-bb3c-ec5e0b95ad73'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:19 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:19 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:20 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.610s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:20 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a is being set with open permissions: ugo+rw Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:20 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:20 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:20 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.589s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:20 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleted volume successfully. Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-afba4909-3c88-4b97-9f4f-607881567dee tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-b1f5eb00-bcce-4707-9902-746acbc7ff28-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:20 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-5104a10c-82da-454a-b9c0-ef617c5d6e9d-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-5104a10c-82da-454a-b9c0-ef617c5d6e9d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:20 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info Apr 10 16:20:20 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-5104a10c-82da-454a-b9c0-ef617c5d6e9d" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-5104a10c-82da-454a-b9c0-ef617c5d6e9d" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8cc951-ddbe-43c4-b354-6024ab4f6f08]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:20 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d Apr 10 16:20:20 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Flow 'volume_create_manager' (f5a26c48-db48-4ca5-a517-04857361e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8110458-b058-4a52-b5a0-91ce1adc200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8110458-b058-4a52-b5a0-91ce1adc200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1448633112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c861ae-70dc-42ac-ba0e-0cc31109dec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb1c9de14ef483e9d5bad981fa10c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:21Z,use_quota=True,user_id='c66b7382ca784690bbe38691cc427299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d342628-0d06-4fce-812c-de1ca2304d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d342628-0d06-4fce-812c-de1ca2304d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0847f-894c-430c-bf93-45e9fc2f882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0847f-894c-430c-bf93-45e9fc2f882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c861ae-70dc-42ac-ba0e-0cc31109dec9', 'volume_name': 'volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd91cb7-4122-4878-809c-6bd7427d2916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd91cb7-4122-4878-809c-6bd7427d2916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:21 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e837727-caec-471c-95ec-98d9bec89f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:21 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Volume e5c861ae-70dc-42ac-ba0e-0cc31109dec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9', 'volume_size': 1} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info" returned: 0 in 0.565s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:21 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info is being set with open permissions: ugo+rw Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:21 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info Apr 10 16:20:21 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:21 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d" returned: 0 in 0.542s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:21 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d Apr 10 16:20:21 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:21 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.info" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.573s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1448633112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c861ae-70dc-42ac-ba0e-0cc31109dec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb1c9de14ef483e9d5bad981fa10c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:21Z,use_quota=True,user_id='c66b7382ca784690bbe38691cc427299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Creating volume e5c861ae-70dc-42ac-ba0e-0cc31109dec9 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:21 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:21 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 1073741824 Apr 10 16:20:21 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:21 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7ae83528-cf51-430b-9ac8-6305dd27f68b tempest-VolumesSnapshotListTestJSON-1010337809 None] Create snapshot completed successfully Apr 10 16:20:21 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5104a10c-82da-454a-b9c0-ef617c5d6e9d" returned: 0 in 0.496s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-5104a10c-82da-454a-b9c0-ef617c5d6e9d" released by "delete_volume" :: held 1.060s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['8b94f485-a1d7-44da-8c78-66eac77eba7c', '45cef029-d207-4d59-ba9b-39ecbc21add5', '4d346f65-ad5d-46be-88d9-03c4e2f92969', 'feea3d0d-5c1e-41c5-bd48-5783ffff2bd7'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:21 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:21 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:22 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 1073741824" returned: 0 in 0.541s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:22 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 Apr 10 16:20:22 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:22 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.475s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:22 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleted volume successfully. Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8268b37-db89-4495-979b-f3e5733cdf25 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-5104a10c-82da-454a-b9c0-ef617c5d6e9d-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-ccc15272-20d9-42d0-ad23-e5021aa91a50-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-ccc15272-20d9-42d0-ad23-e5021aa91a50-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:22 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9" returned: 0 in 0.597s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.424s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-ccc15272-20d9-42d0-ad23-e5021aa91a50" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e837727-caec-471c-95ec-98d9bec89f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580ad431-01be-4828-af52-0e6668fe8bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-ccc15272-20d9-42d0-ad23-e5021aa91a50" acquired by "delete_volume" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:22 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Volume volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 (e5c861ae-70dc-42ac-ba0e-0cc31109dec9): created successfully Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580ad431-01be-4828-af52-0e6668fe8bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Flow 'volume_create_manager' (f5a26c48-db48-4ca5-a517-04857361e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f45125-370a-4c00-8742-d2b0b7087c2c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Creating offline snapshot 29a9ed99-1990-45ee-a503-557730957854 of volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:20:22 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a83a19d4-8253-4775-97de-86bbb56cf107 tempest-VolumesTransfersV355Test-1943336329 None] Created volume successfully. Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f120ee-bf94-4966-a6f6-57192f767c00]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:22 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 Apr 10 16:20:22 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:23 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:23 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:23 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50" returned: 0 in 0.596s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:23 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.572s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:23 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50 Apr 10 16:20:23 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:23 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 1G Apr 10 16:20:23 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:23 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-83f41946-34e8-4a6b-a699-e55971743d0e tempest-VolumesTransfersV355Test-2085400584 None] Transfer volume completed successfully. Apr 10 16:20:23 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccc15272-20d9-42d0-ad23-e5021aa91a50" returned: 0 in 0.464s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-ccc15272-20d9-42d0-ad23-e5021aa91a50" released by "delete_volume" :: held 1.099s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['124d0b4c-8b65-4fe8-aa3f-8e89932bb90e', '109b6d2d-8f17-495f-865f-0c1d90613a1e', '8096e893-4c0d-48a4-be35-4658a8984502', '58e34a4a-f2d2-44d3-aa86-b2e11d7022d4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:24 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:24 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:24 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 1G" returned: 0 in 0.631s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:24 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:24 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Acquiring lock "cinder-e5c861ae-70dc-42ac-ba0e-0cc31109dec9-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-e5c861ae-70dc-42ac-ba0e-0cc31109dec9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Acquiring lock "cinder-quobyte-e5c861ae-70dc-42ac-ba0e-0cc31109dec9" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-quobyte-e5c861ae-70dc-42ac-ba0e-0cc31109dec9" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b837b35-ab4b-4544-9b81-7a3e4c7286ca]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:24 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleted volume successfully. Apr 10 16:20:24 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 Apr 10 16:20:24 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ab94379f-90a2-4500-99d9-2046d0552fd0 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-ccc15272-20d9-42d0-ad23-e5021aa91a50-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:24 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.641s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:24 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 is being set with open permissions: ugo+rw Apr 10 16:20:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:24 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:24 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-49d1aaba-348d-408e-b56e-90e501b0c638-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-49d1aaba-348d-408e-b56e-90e501b0c638-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-2f9acfbb-c006-4702-b852-2101e927e977" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-2f9acfbb-c006-4702-b852-2101e927e977" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-49d1aaba-348d-408e-b56e-90e501b0c638" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-49d1aaba-348d-408e-b56e-90e501b0c638" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleting offline snapshot 49d1aaba-348d-408e-b56e-90e501b0c638 of volume 2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] snapshot_file for this snap is: volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cdaa22-4625-47b7-b7f5-ca0a58cbc133]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:25 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9" returned: 0 in 0.578s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:25 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9 Apr 10 16:20:25 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:25 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 Apr 10 16:20:25 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:25 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.532s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a13deb50-9623-4ffe-903c-75f0be22f276 tempest-VolumesSnapshotListTestJSON-1010337809 None] Create snapshot completed successfully Apr 10 16:20:25 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e5c861ae-70dc-42ac-ba0e-0cc31109dec9" returned: 0 in 0.547s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:25 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-quobyte-e5c861ae-70dc-42ac-ba0e-0cc31109dec9" released by "delete_volume" :: held 1.150s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638" returned: 0 in 0.569s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f9acfbb-c006-4702-b852-2101e927e977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b102f875-a791-444b-9751-4dbf7328ac57]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Created reservations ['6841f5d2-c832-4b68-9478-5bb863ff8689', '99ab526e-9496-49d0-bcfc-039ee3400907', 'c7f857ee-6768-4681-8944-b9ac521cc683', '0c9227ce-fa53-41b5-bbd1-2715e5ddf0ea'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Creating offline snapshot 62357168-cc66-4ce1-84f2-825176f972a2 of volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe70f1-b1b6-4cad-8fad-456d5db7db2e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:25 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 Apr 10 16:20:25 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:25 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:25 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:25 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:25 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:26 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977" returned: 0 in 0.607s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:26 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 Apr 10 16:20:26 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:26 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Deleted volume successfully. Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-96d19b30-ae9b-4e46-a2b2-916188728af3 tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-e5c861ae-70dc-42ac-ba0e-0cc31109dec9-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:26 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.656s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:26 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 1G Apr 10 16:20:26 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:26 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638" returned: 0 in 0.513s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:26 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638 Apr 10 16:20:26 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:26 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 1G" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:27 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 Apr 10 16:20:27 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Flow 'volume_create_manager' (be9e8d12-9f38-4eb8-89d5-e77d484b632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258756e0-fae6-4dc5-b315-1908bac27285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:27 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977.49d1aaba-348d-408e-b56e-90e501b0c638" returned: 0 in 0.554s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258756e0-fae6-4dc5-b315-1908bac27285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1404474083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76596c2b-dfca-4a66-af76-413570bdec86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb1c9de14ef483e9d5bad981fa10c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:27Z,use_quota=True,user_id='c66b7382ca784690bbe38691cc427299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74de2fe8-02cb-413d-9f3d-29bdb18be3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74de2fe8-02cb-413d-9f3d-29bdb18be3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d9240f-ab42-4422-b0f4-d9c92fe4d663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d9240f-ab42-4422-b0f4-d9c92fe4d663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76596c2b-dfca-4a66-af76-413570bdec86', 'volume_name': 'volume-76596c2b-dfca-4a66-af76-413570bdec86', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b38d4d-a3a1-4941-a93e-9d5cd9994bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b38d4d-a3a1-4941-a93e-9d5cd9994bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12f5a90-bf1b-46ff-8b09-8ca780a9ef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:27 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Volume 76596c2b-dfca-4a66-af76-413570bdec86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76596c2b-dfca-4a66-af76-413570bdec86', 'volume_size': 1} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-49d1aaba-348d-408e-b56e-90e501b0c638" released by "_delete_snapshot" :: held 2.347s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-2f9acfbb-c006-4702-b852-2101e927e977" released by "delete_snapshot" :: held 2.356s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['f8afc175-4c4d-4a08-a748-9fb0b6171a54', '61b11907-d9c7-435a-abef-ee589fab599c', 'd940f55d-a2b9-447a-9d4d-8fa7b2596508', '7b53dcd3-d7ad-44e9-9fee-756e01473170'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:27 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Delete snapshot completed successfully. Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5165b000-d1cc-4ab2-a1ba-31f9fb14e38e tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-49d1aaba-348d-408e-b56e-90e501b0c638-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:27 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2" returned: 0 in 0.618s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:27 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 is being set with open permissions: ugo+rw Apr 10 16:20:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:27 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 Apr 10 16:20:27 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:28 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2" returned: 0 in 0.492s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1404474083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76596c2b-dfca-4a66-af76-413570bdec86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb1c9de14ef483e9d5bad981fa10c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:27Z,use_quota=True,user_id='c66b7382ca784690bbe38691cc427299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Creating volume 76596c2b-dfca-4a66-af76-413570bdec86 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:28 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:28 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 1073741824 Apr 10 16:20:28 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:28 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a91eb46c-892c-4146-a6f6-b605d8ebe80b tempest-VolumesSnapshotListTestJSON-1010337809 None] Create snapshot completed successfully Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-2f9acfbb-c006-4702-b852-2101e927e977-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-2f9acfbb-c006-4702-b852-2101e927e977-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "cinder-quobyte-2f9acfbb-c006-4702-b852-2101e927e977" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-2f9acfbb-c006-4702-b852-2101e927e977" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb37c0-c855-4991-989e-04d2b413622f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:28 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 Apr 10 16:20:28 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:28 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 1073741824" returned: 0 in 0.539s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:28 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 Apr 10 16:20:28 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:28 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977" returned: 0 in 0.522s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:28 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977 Apr 10 16:20:28 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:29 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86" returned: 0 in 0.652s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12f5a90-bf1b-46ff-8b09-8ca780a9ef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76596c2b-dfca-4a66-af76-413570bdec86', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d71126e-e670-4fcb-9915-cc77684ee700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Volume volume-76596c2b-dfca-4a66-af76-413570bdec86 (76596c2b-dfca-4a66-af76-413570bdec86): created successfully Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d71126e-e670-4fcb-9915-cc77684ee700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Flow 'volume_create_manager' (be9e8d12-9f38-4eb8-89d5-e77d484b632b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-fb2b938c-73f3-49e0-9cc4-91a8dadc177d tempest-VolumesTransfersV355Test-1943336329 None] Created volume successfully. Apr 10 16:20:29 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2f9acfbb-c006-4702-b852-2101e927e977" returned: 0 in 0.637s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-quobyte-2f9acfbb-c006-4702-b852-2101e927e977" released by "delete_volume" :: held 1.203s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Created reservations ['8e116b0f-7f87-4cde-a626-581481cf17a8', '5241d50f-fd10-4e1a-9b2a-8a924121d7de', '7f3c019b-23fa-46f6-adbc-558dcab6bdc1', 'cdb6b832-e279-49ea-8a1d-7d1170ee29af'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:29 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:29 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-62357168-cc66-4ce1-84f2-825176f972a2-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-62357168-cc66-4ce1-84f2-825176f972a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-62357168-cc66-4ce1-84f2-825176f972a2" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-62357168-cc66-4ce1-84f2-825176f972a2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Deleting offline snapshot 62357168-cc66-4ce1-84f2-825176f972a2 of volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] snapshot_file for this snap is: volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e0b8c-cea8-4dce-8c19-e64a4731d5c8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:29 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 Apr 10 16:20:29 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:30 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.522s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:30 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Deleted volume successfully. Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fedc5ef4-c627-4791-9318-1613b2204362 tempest-CreateVolumesFromSnapshotTest-1656343558 None] Lock "cinder-2f9acfbb-c006-4702-b852-2101e927e977-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:30 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2" returned: 0 in 0.549s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03dd67c-4d0e-40ff-8421-216cc6ef9820]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:30 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:30 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Acquiring lock "cinder-76596c2b-dfca-4a66-af76-413570bdec86-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-76596c2b-dfca-4a66-af76-413570bdec86-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Acquiring lock "cinder-quobyte-76596c2b-dfca-4a66-af76-413570bdec86" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-quobyte-76596c2b-dfca-4a66-af76-413570bdec86" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa0e679-45b4-48bb-a5ad-0e0c46ffeab7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:31 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 Apr 10 16:20:31 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:31 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.784s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:31 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 Apr 10 16:20:31 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:31 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86" returned: 0 in 0.686s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:31 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:31 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86 Apr 10 16:20:31 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2" returned: 0 in 0.612s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:31 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2 Apr 10 16:20:31 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:32 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-76596c2b-dfca-4a66-af76-413570bdec86" returned: 0 in 0.484s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-quobyte-76596c2b-dfca-4a66-af76-413570bdec86" released by "delete_volume" :: held 1.220s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Created reservations ['c3fd7cba-67b7-4050-8060-38469f27d670', '87b42724-89de-40fb-82bf-0a9c186d5580', '4c3ea2a0-5fd4-4493-a1df-0b437ad59c20', '0d65269c-3468-42d5-b5c0-dbf2563a3474'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:32 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.62357168-cc66-4ce1-84f2-825176f972a2" returned: 0 in 0.617s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-62357168-cc66-4ce1-84f2-825176f972a2" released by "_delete_snapshot" :: held 2.619s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" released by "delete_snapshot" :: held 2.647s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:32 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:32 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Created reservations ['331fa52e-1a1d-4239-a417-09f8990c8b55', '1ca66c08-3889-493c-8251-fe758deacbc4', 'baac5167-681d-485b-8b43-72990d7f7b27', 'aeaa8cdc-983a-4f1a-b35c-73da053e4523'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:32 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Delete snapshot completed successfully. Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5d4a5354-44f7-4361-8451-8abf41ca7c85 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-62357168-cc66-4ce1-84f2-825176f972a2-delete_snapshot" released by "delete_snapshot" :: held 2.841s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-29a9ed99-1990-45ee-a503-557730957854-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-29a9ed99-1990-45ee-a503-557730957854-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-29a9ed99-1990-45ee-a503-557730957854" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-29a9ed99-1990-45ee-a503-557730957854" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Deleting offline snapshot 29a9ed99-1990-45ee-a503-557730957854 of volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] snapshot_file for this snap is: volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137f2a6-7138-48a6-a439-dcedd223b7fd]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:33 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:33 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (bc2768ea-59c6-44bb-b3f5-dc7a58eaccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da570368-6fdc-4976-aebe-857f28abdb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da570368-6fdc-4976-aebe-857f28abdb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707091507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49462cc0-c583-4352-8065-92f91bc006ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:33Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca8fcd-f4b8-4b4f-875c-b7931972ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca8fcd-f4b8-4b4f-875c-b7931972ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed15c12-72e7-4c45-aad2-01a27d5d7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed15c12-72e7-4c45-aad2-01a27d5d7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49462cc0-c583-4352-8065-92f91bc006ee', 'volume_name': 'volume-49462cc0-c583-4352-8065-92f91bc006ee', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476aa05b-3737-49b4-9ae5-5dfb7c274e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476aa05b-3737-49b4-9ae5-5dfb7c274e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbda22c8-6d69-418b-bef5-cff716808418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:33 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume 49462cc0-c583-4352-8065-92f91bc006ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49462cc0-c583-4352-8065-92f91bc006ee', 'volume_size': 1} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707091507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49462cc0-c583-4352-8065-92f91bc006ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:33Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Creating volume 49462cc0-c583-4352-8065-92f91bc006ee {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:33 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:33 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.766s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:33 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee 1073741824 Apr 10 16:20:33 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Deleted volume successfully. Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-184c700b-bbe7-4103-9808-d9c1127fb31d tempest-VolumesTransfersV355Test-1265203598 None] Lock "cinder-76596c2b-dfca-4a66-af76-413570bdec86-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:33 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.698s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfcc403-e439-43c0-a689-24b34069155e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:33 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:33 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:34 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee 1073741824" returned: 0 in 0.916s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:34 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee Apr 10 16:20:34 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:34 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.738s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:34 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:34 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:34 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee" returned: 0 in 0.537s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbda22c8-6d69-418b-bef5-cff716808418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49462cc0-c583-4352-8065-92f91bc006ee', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79efd1ff-e668-4e00-9a29-99b64dbc487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:34 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume volume-49462cc0-c583-4352-8065-92f91bc006ee (49462cc0-c583-4352-8065-92f91bc006ee): created successfully Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79efd1ff-e668-4e00-9a29-99b64dbc487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (bc2768ea-59c6-44bb-b3f5-dc7a58eaccef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-51686f99-c780-44e2-b6b9-7ec9f7f9e1df tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created volume successfully. Apr 10 16:20:35 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.663s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:35 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854 Apr 10 16:20:35 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (88e71b15-cbf0-479b-b691-b9eeb11e4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384c1312-8015-44e1-989c-3105343049d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384c1312-8015-44e1-989c-3105343049d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386757194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:35Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd7e1df-a661-42c8-9305-10cee33185e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd7e1df-a661-42c8-9305-10cee33185e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d29e98-0523-448e-b4cb-d41dde7cd882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d29e98-0523-448e-b4cb-d41dde7cd882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2', 'volume_name': 'volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a8e7ea-7994-4f0d-9da4-4a5ca2b12d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a8e7ea-7994-4f0d-9da4-4a5ca2b12d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17acb4e-a1a2-4814-a984-472450221354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume 8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2', 'volume_size': 1} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:35 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386757194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:35Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Creating volume 8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:35 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.29a9ed99-1990-45ee-a503-557730957854" returned: 0 in 0.512s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-29a9ed99-1990-45ee-a503-557730957854" released by "_delete_snapshot" :: held 2.693s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" released by "delete_snapshot" :: held 2.712s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:35 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 1073741824 Apr 10 16:20:35 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (1204c20e-d3f3-4794-829b-7bee86cf84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4324365e-4cf5-4af8-a403-4501082d2159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4324365e-4cf5-4af8-a403-4501082d2159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548326685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cc23e4-a6e8-4a15-8de5-a277ac6b70cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ac8008-472c-4160-ad05-ae6358b1956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ac8008-472c-4160-ad05-ae6358b1956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f916263e-88a1-4a28-bd62-06d178b0e135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f916263e-88a1-4a28-bd62-06d178b0e135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09cc23e4-a6e8-4a15-8de5-a277ac6b70cb', 'volume_name': 'volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e823bad4-f169-4d77-9af5-0405452b4297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e823bad4-f169-4d77-9af5-0405452b4297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e773c4-f948-4657-bfad-5ed63c7a56e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:35 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume 09cc23e4-a6e8-4a15-8de5-a277ac6b70cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb', 'volume_size': 1} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Created reservations ['bfaf0ef1-21d7-4a83-8aeb-127bc99069e3', '9887b0bc-bd27-4572-9766-2ce7c31b3b00', 'fb737260-152b-45cf-aa9a-9358374c1538', '5d4b35c9-c86d-42e5-850a-21619d54aa79'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:35 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Delete snapshot completed successfully. Apr 10 16:20:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fb2e2f1c-7055-43f2-851d-ca0a47f226ee tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-29a9ed99-1990-45ee-a503-557730957854-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (9e6dfe73-4578-4090-907b-2a740d541b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c0e213-b749-41ad-a89e-5939ef05987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-84659d6a-9e88-42b2-a398-fa7d8fc3ea4a-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c0e213-b749-41ad-a89e-5939ef05987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651379508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55eb897-a730-449c-b93a-f56f8d2b0b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a72227-ffae-4f49-a6cd-99231946bc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a72227-ffae-4f49-a6cd-99231946bc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43324be-c726-4e74-84ee-3dfc7d648740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43324be-c726-4e74-84ee-3dfc7d648740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55eb897-a730-449c-b93a-f56f8d2b0b95', 'volume_name': 'volume-e55eb897-a730-449c-b93a-f56f8d2b0b95', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf54dbc6-6023-414f-a32a-d01d8f70c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf54dbc6-6023-414f-a32a-d01d8f70c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6668962f-0c8c-4fca-82cf-c6b891a5b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume e55eb897-a730-449c-b93a-f56f8d2b0b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55eb897-a730-449c-b93a-f56f8d2b0b95', 'volume_size': 1} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-84659d6a-9e88-42b2-a398-fa7d8fc3ea4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.130s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (aa462d70-0396-462a-b574-e343728672a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c84cd0a-c02b-4a39-baf0-06145ebf4593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c84cd0a-c02b-4a39-baf0-06145ebf4593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392423173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b201d4-3127-48b9-b091-6dadb9dff248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf29933-9fd7-48c4-a2ba-dbca9101f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf29933-9fd7-48c4-a2ba-dbca9101f536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3f283c-4c19-4316-8204-a5d7bfaee670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3f283c-4c19-4316-8204-a5d7bfaee670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b201d4-3127-48b9-b091-6dadb9dff248', 'volume_name': 'volume-14b201d4-3127-48b9-b091-6dadb9dff248', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7610d8e1-3e5b-4623-9a65-a7bbd4fbb5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7610d8e1-3e5b-4623-9a65-a7bbd4fbb5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f2b1ab-b315-483a-bcc0-9528e150341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume 14b201d4-3127-48b9-b091-6dadb9dff248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b201d4-3127-48b9-b091-6dadb9dff248', 'volume_size': 1} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" acquired by "_delete_snapshot" :: waited 0.131s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Deleting offline snapshot 84659d6a-9e88-42b2-a398-fa7d8fc3ea4a of volume b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] snapshot_file for this snap is: volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6de7c-3d99-4b7f-bc73-30599a32ea81]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:36 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 1073741824" returned: 0 in 0.909s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:36 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:36 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (4d090cc0-7d06-42a1-8ca8-95a056ec922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddc0f8e-e541-4c6a-9182-5eefcc36307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddc0f8e-e541-4c6a-9182-5eefcc36307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984570317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4015d74-e095-47a0-9773-151947e6d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4015d74-e095-47a0-9773-151947e6d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0332e79-4e1e-4ebf-b521-18b64f0133cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0332e79-4e1e-4ebf-b521-18b64f0133cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0', 'volume_name': 'volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78afbb3-835f-4009-9542-f2b97cb4f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78afbb3-835f-4009-9542-f2b97cb4f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16ec3a9-d662-4e05-a347-f596901a9d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:36 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume 8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0', 'volume_size': 1} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:36 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 Apr 10 16:20:36 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:36 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.539s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55afb67-bd19-460f-b0a2-dfc382166a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeba1c5-e1cc-4358-8a5e-3f091baf6ebd]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:37 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d Apr 10 16:20:37 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:37 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2" returned: 0 in 0.556s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548326685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cc23e4-a6e8-4a15-8de5-a277ac6b70cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Creating volume 09cc23e4-a6e8-4a15-8de5-a277ac6b70cb {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:37 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17acb4e-a1a2-4814-a984-472450221354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:37 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb 1073741824 Apr 10 16:20:37 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df32792a-ce04-4e66-98e3-736f7fbe46f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:37 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 (8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2): created successfully Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df32792a-ce04-4e66-98e3-736f7fbe46f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (88e71b15-cbf0-479b-b691-b9eeb11e4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c5c08d42-a045-4d6e-bed5-dff699ac28d3 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created volume successfully. Apr 10 16:20:37 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d" returned: 0 in 0.599s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:37 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:37 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:37 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb 1073741824" returned: 0 in 0.610s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:37 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb Apr 10 16:20:37 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:38 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.599s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:38 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a Apr 10 16:20:38 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Flow 'volume_create_manager' (10a8fcd4-7921-4b93-8e33-13923f2e5d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938df8f9-dde2-443e-9e23-b5abe7cc98ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938df8f9-dde2-443e-9e23-b5abe7cc98ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2027486323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabbbcb-8f34-4f29-be0d-ec2c56febb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f2c9a0f7d34e68bafccbacd7271134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:38Z,use_quota=True,user_id='308701d0e58644df892997c57aef6c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826ece84-c5ca-4fbb-8512-6f934cb9889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826ece84-c5ca-4fbb-8512-6f934cb9889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae398ca6-2c04-4beb-9619-b3828ba955c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae398ca6-2c04-4beb-9619-b3828ba955c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daabbbcb-8f34-4f29-be0d-ec2c56febb10', 'volume_name': 'volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985a0b21-2140-406e-b679-36b9b85cd0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985a0b21-2140-406e-b679-36b9b85cd0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0562ebad-6df9-4c95-8cac-c785ed7a9629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:38 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Volume daabbbcb-8f34-4f29-be0d-ec2c56febb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10', 'volume_size': 1} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:38 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb" returned: 0 in 0.519s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651379508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55eb897-a730-449c-b93a-f56f8d2b0b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Creating volume e55eb897-a730-449c-b93a-f56f8d2b0b95 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:38 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e773c4-f948-4657-bfad-5ed63c7a56e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef1889-aa05-4a89-b4d3-6c59771a208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:38 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 1073741824 Apr 10 16:20:38 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:38 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb (09cc23e4-a6e8-4a15-8de5-a277ac6b70cb): created successfully Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef1889-aa05-4a89-b4d3-6c59771a208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (1204c20e-d3f3-4794-829b-7bee86cf84fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-cd2a5595-f9df-4541-97be-6d908b52f6ce tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created volume successfully. Apr 10 16:20:38 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d.84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" returned: 0 in 0.432s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-84659d6a-9e88-42b2-a398-fa7d8fc3ea4a" released by "_delete_snapshot" :: held 2.242s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" released by "delete_snapshot" :: held 2.381s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Created reservations ['9102de31-d422-4a57-a9f8-f2782851a8bd', '162d2bd9-cc03-4631-97ca-bbdb4406d3f4', 'd24bdaa8-a451-49a2-94fb-902d902ba199', '1a013130-65ce-4b10-92cb-c58bf66957f4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Delete snapshot completed successfully. Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f9bd6927-330b-4dd1-8ad9-7b97c536f3a1 tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-84659d6a-9e88-42b2-a398-fa7d8fc3ea4a-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:38 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 1073741824" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:38 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 Apr 10 16:20:38 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-b55afb67-bd19-460f-b0a2-dfc382166a1d-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-b55afb67-bd19-460f-b0a2-dfc382166a1d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:39 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95" returned: 0 in 0.497s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392423173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b201d4-3127-48b9-b091-6dadb9dff248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Creating volume 14b201d4-3127-48b9-b091-6dadb9dff248 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:39 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6668962f-0c8c-4fca-82cf-c6b891a5b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55eb897-a730-449c-b93a-f56f8d2b0b95', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef70723a-9f53-40e8-90d9-bf1b0c2d885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:39 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 1073741824 Apr 10 16:20:39 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:39 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 (e55eb897-a730-449c-b93a-f56f8d2b0b95): created successfully Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef70723a-9f53-40e8-90d9-bf1b0c2d885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (9e6dfe73-4578-4090-907b-2a740d541b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:39 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f50c3e3a-6e7b-40e7-b43f-44dc33e2d483 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created volume successfully. Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b2aa4a-278d-4275-8f8a-efe73a6555ae]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:39 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d Apr 10 16:20:39 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:39 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 1073741824" returned: 0 in 0.593s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:39 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 Apr 10 16:20:39 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:40 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d" returned: 0 in 0.610s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:40 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d Apr 10 16:20:40 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:40 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984570317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b423b159650408f8ef265a93545b8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:36Z,use_quota=True,user_id='4d95adffa25a4e8f9f0737a7a81f4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Creating volume 8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:40 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f2b1ab-b315-483a-bcc0-9528e150341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b201d4-3127-48b9-b091-6dadb9dff248', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfa67dc-454f-4d72-b309-63d4179dbdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:40 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 1073741824 Apr 10 16:20:40 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume volume-14b201d4-3127-48b9-b091-6dadb9dff248 (14b201d4-3127-48b9-b091-6dadb9dff248): created successfully Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfa67dc-454f-4d72-b309-63d4179dbdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:40 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (aa462d70-0396-462a-b574-e343728672a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b55afb67-bd19-460f-b0a2-dfc382166a1d" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-quobyte-b55afb67-bd19-460f-b0a2-dfc382166a1d" released by "delete_volume" :: held 1.145s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-613e5402-0391-40c9-8559-2f049fdd97d7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created volume successfully. Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Created reservations ['e3201007-f3f1-4046-a472-a92122b9a783', '4e0751ba-59cf-4f4b-b78d-62dcb5125533', '060127f0-57d0-4b5f-8209-5cd0c02f10bd', '83a2f2f1-3b10-495e-86a7-64c363082d71'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:40 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:40 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:41 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.435s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Deleted volume successfully. Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-fd845386-f6e8-4132-9166-bc480ad4c6ea tempest-VolumesSnapshotListTestJSON-1010337809 None] Lock "cinder-b55afb67-bd19-460f-b0a2-dfc382166a1d-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:41 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 1073741824" returned: 0 in 0.633s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:41 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 Apr 10 16:20:41 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:41 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0" returned: 0 in 0.476s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2027486323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabbbcb-8f34-4f29-be0d-ec2c56febb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f2c9a0f7d34e68bafccbacd7271134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:38Z,use_quota=True,user_id='308701d0e58644df892997c57aef6c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Creating volume daabbbcb-8f34-4f29-be0d-ec2c56febb10 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:41 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16ec3a9-d662-4e05-a347-f596901a9d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:41 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 1073741824 Apr 10 16:20:41 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf7af3e-0024-4286-9e0c-4673b0e77c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:41 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Volume volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 (8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0): created successfully Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf7af3e-0024-4286-9e0c-4673b0e77c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Flow 'volume_create_manager' (4d090cc0-7d06-42a1-8ca8-95a056ec922f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-36f91acc-236d-4862-82e1-78bdcd9b2bf4 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created volume successfully. Apr 10 16:20:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-quobyte-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0daac9-68fd-405e-bf98-fba4e2c21198]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:42 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 Apr 10 16:20:42 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:42 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 1073741824" returned: 0 in 0.559s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:42 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 Apr 10 16:20:42 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:42 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10" returned: 0 in 0.480s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0562ebad-6df9-4c95-8cac-c785ed7a9629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb3a23d-7e12-4de6-ae3d-308143b4c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:42 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Volume volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 (daabbbcb-8f34-4f29-be0d-ec2c56febb10): created successfully Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb3a23d-7e12-4de6-ae3d-308143b4c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Flow 'volume_create_manager' (10a8fcd4-7921-4b93-8e33-13923f2e5d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:42 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-06108300-80fb-4e40-ad27-b7aa381e61a9 tempest-VolumesTransfersV357Test-639802633 None] Created volume successfully. Apr 10 16:20:42 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0" returned: 0 in 0.710s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:42 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0 Apr 10 16:20:42 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:43 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0" returned: 0 in 0.507s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0" released by "delete_volume" :: held 1.243s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created reservations ['42391ab6-842d-44b9-8161-d2763444e324', 'dcf6147f-7f1c-4680-93c9-65d042b145be', '66c9a230-ee87-499c-a82f-a991513be5fa', '10bd08fb-61d2-455d-bd2a-7e79cf6951af'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:43 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:43 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:43 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.543s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:43 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:43 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Deleted volume successfully. Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2d79e021-b3ef-4654-8bd5-bf2d2731d345 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-8e45eb7e-9378-4ca1-9ea3-acf2c828f1c0-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-37d1c321-f0b5-46f9-a7bd-65acf2b2cf6d tempest-VolumesTransfersV357Test-1611750606 None] Transfer volume completed successfully. Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-14b201d4-3127-48b9-b091-6dadb9dff248-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-14b201d4-3127-48b9-b091-6dadb9dff248-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-quobyte-14b201d4-3127-48b9-b091-6dadb9dff248" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-14b201d4-3127-48b9-b091-6dadb9dff248" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a0a5b-835a-428e-88f5-cc34ca62dea1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:44 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 Apr 10 16:20:44 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:44 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248" returned: 0 in 0.554s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:44 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248 Apr 10 16:20:44 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Acquiring lock "cinder-daabbbcb-8f34-4f29-be0d-ec2c56febb10-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-daabbbcb-8f34-4f29-be0d-ec2c56febb10-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Acquiring lock "cinder-quobyte-daabbbcb-8f34-4f29-be0d-ec2c56febb10" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-quobyte-daabbbcb-8f34-4f29-be0d-ec2c56febb10" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2482d-6a26-42c0-a2b4-d5f9ada3efe7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:45 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 Apr 10 16:20:45 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:45 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-14b201d4-3127-48b9-b091-6dadb9dff248" returned: 0 in 0.481s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-14b201d4-3127-48b9-b091-6dadb9dff248" released by "delete_volume" :: held 1.060s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created reservations ['a5f64938-f9c7-4b0a-9ca3-8599e9226747', 'bf8b7de9-069c-40f3-a3e2-bb245b07a008', '54c47391-caca-4a66-81fe-44b4f7e696c2', 'e2334777-f62a-49b7-9d74-4bcce61b1080'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:45 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:45 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:45 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10" returned: 0 in 0.606s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:45 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10 Apr 10 16:20:45 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:46 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.602s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:46 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Deleted volume successfully. Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-876c2c11-c590-4ca6-9842-13e7a68dc538 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-14b201d4-3127-48b9-b091-6dadb9dff248-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:46 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-daabbbcb-8f34-4f29-be0d-ec2c56febb10" returned: 0 in 0.557s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-quobyte-daabbbcb-8f34-4f29-be0d-ec2c56febb10" released by "delete_volume" :: held 1.191s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Created reservations ['24b80ccb-13f9-4c7e-99ab-33366779cb4a', '3b44c8d9-a52d-42f2-8700-f597b9d24625', '289a4c72-866a-4e03-aa06-695a0f8a2242', 'ae9d4fb6-9c4c-4685-8382-822c18a76e43'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:46 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:46 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-e55eb897-a730-449c-b93a-f56f8d2b0b95-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-e55eb897-a730-449c-b93a-f56f8d2b0b95-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:47 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.493s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:47 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Deleted volume successfully. Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-quobyte-e55eb897-a730-449c-b93a-f56f8d2b0b95" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-e55eb897-a730-449c-b93a-f56f8d2b0b95" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f9019-25f5-438d-8fb6-6a3d6c8e755d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:47 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 Apr 10 16:20:47 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-52279c44-6217-40b4-9015-7703983518a4 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-daabbbcb-8f34-4f29-be0d-ec2c56febb10-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:47 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95" returned: 0 in 0.577s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:47 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95 Apr 10 16:20:47 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:48 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e55eb897-a730-449c-b93a-f56f8d2b0b95" returned: 0 in 0.451s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-e55eb897-a730-449c-b93a-f56f8d2b0b95" released by "delete_volume" :: held 1.066s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:51 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=237,cinder:SELECT=180,cinder:INSERT=55,cinder:DELETE=24 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created reservations ['305f5a30-75d1-44cb-abf1-67f304d5ea92', 'fa7ac51e-56fb-4015-a5f9-2ef8f6a6ec75', 'cedba34a-7b55-4ff2-8592-0628bbab85ef', 'b43d5c5a-39b6-407d-8d2f-8319ca968565'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:52 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:52 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Flow 'volume_create_manager' (d29d7f4b-04d3-4ef6-95a3-78043cb08490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff3766c-7ac8-4690-8938-256a3b93e2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff3766c-7ac8-4690-8938-256a3b93e2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1180970841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c864fe9b-c3a3-4cd2-900d-3644aa3eb31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f2c9a0f7d34e68bafccbacd7271134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:52Z,use_quota=True,user_id='308701d0e58644df892997c57aef6c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e8dd00-ec93-45e3-bbec-ee806de7c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e8dd00-ec93-45e3-bbec-ee806de7c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe29310-13d8-42e6-8dcd-745666cb190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe29310-13d8-42e6-8dcd-745666cb190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c864fe9b-c3a3-4cd2-900d-3644aa3eb31e', 'volume_name': 'volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab60124-6d88-417f-afe9-981f9726d2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab60124-6d88-417f-afe9-981f9726d2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a264378-654f-4850-843e-379c79f917fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:52 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Volume c864fe9b-c3a3-4cd2-900d-3644aa3eb31e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e', 'volume_size': 1} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1180970841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c864fe9b-c3a3-4cd2-900d-3644aa3eb31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f2c9a0f7d34e68bafccbacd7271134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:52Z,use_quota=True,user_id='308701d0e58644df892997c57aef6c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Creating volume c864fe9b-c3a3-4cd2-900d-3644aa3eb31e {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:52 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:52 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e 1073741824 Apr 10 16:20:52 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-quobyte-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf015de1-5068-4cad-94a6-628a2de6c845]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:53 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb Apr 10 16:20:53 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (c34358f1-8fe6-49e0-872d-3a18eecaea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb7cd05-f274-4323-8482-89738c061339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:53 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb7cd05-f274-4323-8482-89738c061339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1739773105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb29269-c5fc-43e8-b0e3-f354d1f85e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:53Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6bb2ce-4bea-4422-b0b0-29411f3a3d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6bb2ce-4bea-4422-b0b0-29411f3a3d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19983417-6ed4-4dbf-9f9c-e4ae9650c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19983417-6ed4-4dbf-9f9c-e4ae9650c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb29269-c5fc-43e8-b0e3-f354d1f85e58', 'volume_name': 'volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd5df74-15b8-43ed-9fe3-5229a80f8411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd5df74-15b8-43ed-9fe3-5229a80f8411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0ccf62-6f77-49ed-8671-f6ea80e8f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:53 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Volume 3cb29269-c5fc-43e8-b0e3-f354d1f85e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58', 'volume_size': 1} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.052s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Deleted volume successfully. Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-70d14027-31d5-4e9b-a238-9af88334083f tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-e55eb897-a730-449c-b93a-f56f8d2b0b95-delete_volume" released by "delete_volume" :: held 6.676s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:53 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e 1073741824" returned: 0 in 1.044s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:53 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e Apr 10 16:20:53 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:53 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb" returned: 0 in 0.917s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:53 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb Apr 10 16:20:53 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:54 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e" returned: 0 in 0.482s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1739773105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb29269-c5fc-43e8-b0e3-f354d1f85e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:20:53Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Creating volume 3cb29269-c5fc-43e8-b0e3-f354d1f85e58 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:20:54 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:54 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 1073741824 Apr 10 16:20:54 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a264378-654f-4850-843e-379c79f917fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bf62b4-e592-421e-ba2a-c0b65d3b6c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=169,cinder:INSERT=65,cinder:UPDATE=246,cinder:DELETE=18 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:20:54 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Volume volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e (c864fe9b-c3a3-4cd2-900d-3644aa3eb31e): created successfully Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bf62b4-e592-421e-ba2a-c0b65d3b6c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Flow 'volume_create_manager' (d29d7f4b-04d3-4ef6-95a3-78043cb08490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-94bdeb42-d6b7-40ae-8671-220f662fd60f tempest-VolumesTransfersV357Test-639802633 None] Created volume successfully. Apr 10 16:20:54 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb" returned: 0 in 0.635s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb" released by "delete_volume" :: held 1.593s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created reservations ['f39420bd-cf43-4dd9-80d4-59f594fd8fac', 'd221db31-834e-49d5-818e-c31a6bdfebd5', '4bdced46-f77c-41aa-bd5e-8e06e0b1630a', '820ce6bb-3ae2-40d6-ba3c-0f5af9067142'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:54 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:54 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Acquiring lock "cinder-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Acquiring lock "cinder-quobyte-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-quobyte-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e" acquired by "delete_volume" :: waited 0.027s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2efe9a-b02d-4205-9761-13d994425898]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:55 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:55 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e Apr 10 16:20:55 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 1073741824" returned: 0 in 1.023s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-quobyte-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2" acquired by "delete_volume" :: waited 0.062s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:55 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 Apr 10 16:20:55 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a58e94-94f8-4a89-84cc-a0caa028a506]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:55 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.921s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:55 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Deleted volume successfully. Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7e627cc7-04c9-4942-b768-547bb766ece7 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-09cc23e4-a6e8-4a15-8de5-a277ac6b70cb-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:55 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 Apr 10 16:20:55 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:55 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e" returned: 0 in 0.813s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:55 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e Apr 10 16:20:55 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:56 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2" returned: 0 in 0.801s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:56 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2 Apr 10 16:20:56 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:56 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" returned: 0 in 1.003s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0ccf62-6f77-49ed-8671-f6ea80e8f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f520b3-a37e-4f85-b5b3-141bed1fa315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:20:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Volume volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 (3cb29269-c5fc-43e8-b0e3-f354d1f85e58): created successfully Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f520b3-a37e-4f85-b5b3-141bed1fa315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (c34358f1-8fe6-49e0-872d-3a18eecaea28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:20:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-866532ad-139a-4c3e-8830-00a4854ce6be tempest-VolumesActionsTest-241540850 None] Created volume successfully. Apr 10 16:20:56 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e" returned: 0 in 0.834s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-quobyte-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e" released by "delete_volume" :: held 1.673s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Created reservations ['13aaa6b7-aac7-4075-9827-18f311cbb903', 'fd810d2d-81a8-43c5-975e-58b6db6cd324', '61e1d742-295b-473c-841c-14e8b020be8c', '2c0f3d89-4b14-47ac-932e-d1e61a7cce09'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:56 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2" returned: 0 in 0.616s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2" released by "delete_volume" :: held 1.520s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:56 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:56 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created reservations ['1769a5ce-1f2f-49aa-ad7b-3edfd3acc48b', '5a74dc99-6a73-4646-bf21-f78656e7fd37', '3a54b27d-d102-421e-b462-489187431117', '850a8dd6-5f7a-475d-82c9-2feaa45a0ec4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:57 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:57 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:57 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.587s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Deleted volume successfully. Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b687f038-7fe8-4b8c-94de-b5cd6079a3d8 tempest-VolumesTransfersV357Test-1437273528 None] Lock "cinder-c864fe9b-c3a3-4cd2-900d-3644aa3eb31e-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-49462cc0-c583-4352-8065-92f91bc006ee-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-49462cc0-c583-4352-8065-92f91bc006ee-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ffa799f5-e6a6-4b31-9948-a275bd5d2aa5 tempest-VolumesActionsTest-241540850 None] Acquiring lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" by "attach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "cinder-quobyte-49462cc0-c583-4352-8065-92f91bc006ee" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-49462cc0-c583-4352-8065-92f91bc006ee" acquired by "delete_volume" :: waited 0.028s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ffa799f5-e6a6-4b31-9948-a275bd5d2aa5 tempest-VolumesActionsTest-241540850 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" acquired by "attach_volume" :: waited 0.053s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee1a4d1-e8e1-4b9a-be95-5a8e32627705]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:20:57 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.816s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:20:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Deleted volume successfully. Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-392342cb-399d-4b54-abbd-db8316b3fdb6 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-8ae5242c-bd2c-4ad4-b2b7-bf6ff127c9d2-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ffa799f5-e6a6-4b31-9948-a275bd5d2aa5 tempest-VolumesActionsTest-241540850 None] Attaching volume 3cb29269-c5fc-43e8-b0e3-f354d1f85e58 to instance 80d49e20-9e56-4003-93a6-9bed12f925e5 at mountpoint /dev/vdb on host None. Apr 10 16:20:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ffa799f5-e6a6-4b31-9948-a275bd5d2aa5 tempest-VolumesActionsTest-241540850 None] Attach volume completed successfully. Apr 10 16:20:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ffa799f5-e6a6-4b31-9948-a275bd5d2aa5 tempest-VolumesActionsTest-241540850 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" released by "attach_volume" :: held 0.199s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:57 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee Apr 10 16:20:57 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:58 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee" returned: 0 in 0.970s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:58 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee Apr 10 16:20:58 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:20:58 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-acd2675f-a5c4-4f6b-a562-57c3b26ed193 tempest-VolumesActionsTest-832468973 None] Terminate volume connection completed successfully. Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-acd2675f-a5c4-4f6b-a562-57c3b26ed193 tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-detach_volume" by "detach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-acd2675f-a5c4-4f6b-a562-57c3b26ed193 tempest-VolumesActionsTest-832468973 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:20:59 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 10 16:20:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-acd2675f-a5c4-4f6b-a562-57c3b26ed193 tempest-VolumesActionsTest-832468973 None] Detaching volume 3cb29269-c5fc-43e8-b0e3-f354d1f85e58 from instance 80d49e20-9e56-4003-93a6-9bed12f925e5. Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-49462cc0-c583-4352-8065-92f91bc006ee" returned: 0 in 0.703s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-quobyte-49462cc0-c583-4352-8065-92f91bc006ee" released by "delete_volume" :: held 1.766s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-acd2675f-a5c4-4f6b-a562-57c3b26ed193 tempest-VolumesActionsTest-832468973 None] Detach volume completed successfully. Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-acd2675f-a5c4-4f6b-a562-57c3b26ed193 tempest-VolumesActionsTest-832468973 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Created reservations ['7a2ebe34-e033-48d0-a602-3403c56c628e', '572670a1-32c0-410a-a8f2-057a3ae20040', 'a081667f-9ba8-44bc-ba2a-b2133e9d1804', 'aceeb353-9395-4030-a087-b4ec7c84f12c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:20:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:20:59 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:20:59 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1645f0dc-8231-4625-aea8-8dfcb913eaf3 tempest-VolumesActionsTest-241540850 None] Acquiring lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-detach_volume" by "detach_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1645f0dc-8231-4625-aea8-8dfcb913eaf3 tempest-VolumesActionsTest-241540850 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:00 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1645f0dc-8231-4625-aea8-8dfcb913eaf3 tempest-VolumesActionsTest-241540850 None] Volume detach called, but volume not attached. Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1645f0dc-8231-4625-aea8-8dfcb913eaf3 tempest-VolumesActionsTest-241540850 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:00 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.700s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:00 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Deleted volume successfully. Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-209b9da3-9967-46f5-a3cb-380996d11108 tempest-CreateVolumesFromSourceVolumeTest-985039179 None] Lock "cinder-49462cc0-c583-4352-8065-92f91bc006ee-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Acquiring lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Acquiring lock "cinder-quobyte-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Lock "cinder-quobyte-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0fda34-2bec-45ed-bc69-fdfdef05a156]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:01 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 Apr 10 16:21:01 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:01 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" returned: 0 in 0.841s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:01 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58 Apr 10 16:21:01 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:02 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" returned: 0 in 0.549s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Lock "cinder-quobyte-3cb29269-c5fc-43e8-b0e3-f354d1f85e58" released by "delete_volume" :: held 1.423s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Created reservations ['54874e43-a56f-45d1-9652-18288c94a1d4', '38186c9b-2f8f-4b41-9cb2-f60dec8ae451', '4096f574-f704-4bda-bc15-487a8a322e8a', 'ef04ee37-3118-4077-8cd1-75baea84f7aa'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:02 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:02 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:02 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (f5512a1d-29df-4193-b06e-f75b7775af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5de4971-c98f-4e2d-b37a-56bc57558e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Deleted volume successfully. Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5de4971-c98f-4e2d-b37a-56bc57558e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-970748183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb9f660-57d0-4ec0-9cc6-35aeea257959,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:03Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b526354e-2c25-44b0-8eaf-78c66ddfe8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b526354e-2c25-44b0-8eaf-78c66ddfe8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4e58a6-d67b-4f74-9201-cd5fdb575de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4e58a6-d67b-4f74-9201-cd5fdb575de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb9f660-57d0-4ec0-9cc6-35aeea257959', 'volume_name': 'volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d310a8c0-594a-417c-857f-fdaad39f1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d310a8c0-594a-417c-857f-fdaad39f1435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d9b404-9ed8-4770-a276-b3e0b38a1747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:03 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Volume ccb9f660-57d0-4ec0-9cc6-35aeea257959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959', 'volume_size': 1} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-970748183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb9f660-57d0-4ec0-9cc6-35aeea257959,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:03Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Creating volume ccb9f660-57d0-4ec0-9cc6-35aeea257959 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:03 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d6914c6-3b95-4d58-9ab9-491e88b57b12 tempest-VolumesActionsTest-241540850 None] Lock "cinder-3cb29269-c5fc-43e8-b0e3-f354d1f85e58-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:03 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 1073741824 Apr 10 16:21:03 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:03 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 1073741824" returned: 0 in 0.705s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:03 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 Apr 10 16:21:03 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:04 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959" returned: 0 in 0.509s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d9b404-9ed8-4770-a276-b3e0b38a1747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366acba5-f576-4f0d-9e75-f68bd3fdab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Volume volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 (ccb9f660-57d0-4ec0-9cc6-35aeea257959): created successfully Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366acba5-f576-4f0d-9e75-f68bd3fdab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (f5512a1d-29df-4193-b06e-f75b7775af0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:04 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-32d6e096-f99b-43a0-9664-49815d0e7b83 tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (5c66dfbc-8f7f-46a8-8bfd-b221359a9534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab70b62c-ec6f-4972-be9a-c5f310b790f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab70b62c-ec6f-4972-be9a-c5f310b790f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1958859785',display_name='tempest-VolumesGetTest-Volume-613785006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ab5880-f95d-4635-8f69-8a3a74062505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:06Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a2d7a8-af09-45e2-bf2c-f44fbf1b6e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a2d7a8-af09-45e2-bf2c-f44fbf1b6e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d109b6-1151-4825-99d7-5a04085a8c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d109b6-1151-4825-99d7-5a04085a8c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ab5880-f95d-4635-8f69-8a3a74062505', 'volume_name': 'volume-86ab5880-f95d-4635-8f69-8a3a74062505', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b79b75-b92f-4c8b-ac96-625182446d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b79b75-b92f-4c8b-ac96-625182446d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf65249-9241-417b-89e6-89784c918a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Volume 86ab5880-f95d-4635-8f69-8a3a74062505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ab5880-f95d-4635-8f69-8a3a74062505', 'volume_size': 1} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1958859785',display_name='tempest-VolumesGetTest-Volume-613785006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ab5880-f95d-4635-8f69-8a3a74062505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:06Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Creating volume 86ab5880-f95d-4635-8f69-8a3a74062505 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:05 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:05 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 1073741824 Apr 10 16:21:05 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:06 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 1073741824" returned: 0 in 0.649s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:06 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 Apr 10 16:21:06 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:06 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf65249-9241-417b-89e6-89784c918a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ab5880-f95d-4635-8f69-8a3a74062505', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc85282-5cff-4609-a115-e6476c593c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:06 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Volume volume-86ab5880-f95d-4635-8f69-8a3a74062505 (86ab5880-f95d-4635-8f69-8a3a74062505): created successfully Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc85282-5cff-4609-a115-e6476c593c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (5c66dfbc-8f7f-46a8-8bfd-b221359a9534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-de8f8cc2-bd93-4f34-b511-3afd1bacedf9 tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-86ab5880-f95d-4635-8f69-8a3a74062505-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Lock "cinder-86ab5880-f95d-4635-8f69-8a3a74062505-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Flow 'volume_create_manager' (6e06ce07-7ee3-4e59-943b-43636d7d92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b578571-6c04-48fb-a1dd-0f3c216a6c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b578571-6c04-48fb-a1dd-0f3c216a6c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-442622380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910e4c8a-d4b8-4bde-8abc-1eca2cf669a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47db37b7ab4f43fba9462c40463f8225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:08Z,use_quota=True,user_id='c0ff38dd247e4b24a5dfa31d502cd7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce108f1-6f6d-4216-ac43-7830e0d774de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce108f1-6f6d-4216-ac43-7830e0d774de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1dc614-8b61-44fa-8ae6-d17ccb07d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1dc614-8b61-44fa-8ae6-d17ccb07d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910e4c8a-d4b8-4bde-8abc-1eca2cf669a4', 'volume_name': 'volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124cc9d8-5ea3-4743-a718-c44dde8f6075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124cc9d8-5ea3-4743-a718-c44dde8f6075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79f988b-d1fc-4b13-8234-cb602374240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:07 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Volume 910e4c8a-d4b8-4bde-8abc-1eca2cf669a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4', 'volume_size': 1} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-442622380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910e4c8a-d4b8-4bde-8abc-1eca2cf669a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47db37b7ab4f43fba9462c40463f8225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:08Z,use_quota=True,user_id='c0ff38dd247e4b24a5dfa31d502cd7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Creating volume 910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:07 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-86ab5880-f95d-4635-8f69-8a3a74062505" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:07 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 1073741824 Apr 10 16:21:07 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-86ab5880-f95d-4635-8f69-8a3a74062505" acquired by "delete_volume" :: waited 0.020s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c52d7e-48e9-4624-b4b0-3f5fe530fd37]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:08 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 Apr 10 16:21:08 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:08 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 1073741824" returned: 0 in 0.510s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:08 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:08 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:08 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505" returned: 0 in 0.510s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:08 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505 Apr 10 16:21:08 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:08 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.430s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79f988b-d1fc-4b13-8234-cb602374240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc787ae-f224-40d9-ad91-77d2db983140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:08 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Volume volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 (910e4c8a-d4b8-4bde-8abc-1eca2cf669a4): created successfully Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc787ae-f224-40d9-ad91-77d2db983140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:08 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Flow 'volume_create_manager' (6e06ce07-7ee3-4e59-943b-43636d7d92ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-86ab5880-f95d-4635-8f69-8a3a74062505" returned: 0 in 0.440s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-86ab5880-f95d-4635-8f69-8a3a74062505" released by "delete_volume" :: held 0.973s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:08 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-89eeee2c-607f-43d8-be15-f7b1d9a280d5 tempest-SnapshotDependencyTests-1486398920 None] Created volume successfully. Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Created reservations ['b62c9947-3c3e-43dd-9c5b-b9125b15f05c', '4d37f58c-b1a3-49e2-85ad-fea415720f7e', 'f31dba32-db41-4579-8f6d-c6cf8c95b82e', '93929274-01e9-41ac-aa73-03f586c1f820'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:09 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:09 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:09 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.427s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:09 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8453b03a-b09c-47a7-a5f5-84c1eaf59028 tempest-VolumesGetTest-1222723237 None] Lock "cinder-86ab5880-f95d-4635-8f69-8a3a74062505-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-ccb9f660-57d0-4ec0-9cc6-35aeea257959-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Lock "cinder-ccb9f660-57d0-4ec0-9cc6-35aeea257959-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-ccb9f660-57d0-4ec0-9cc6-35aeea257959" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-ccb9f660-57d0-4ec0-9cc6-35aeea257959" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[67882253-e74e-4da3-8c11-02010ce2c19b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Creating offline snapshot 03f28f3b-0f67-4efd-815e-df9ec37283cb of volume 910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f828bd81-d75b-4046-a495-691dcb97117b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:10 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 Apr 10 16:21:10 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:10 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:10 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:10 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959" returned: 0 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:10 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959 Apr 10 16:21:10 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:10 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.498s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:10 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb 1G Apr 10 16:21:10 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:11 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-ccb9f660-57d0-4ec0-9cc6-35aeea257959" returned: 0 in 0.488s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (3f279e38-5005-4dcb-9713-3522e6315733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126f592f-6c34-490f-860b-e6d3edaa19c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-ccb9f660-57d0-4ec0-9cc6-35aeea257959" released by "delete_volume" :: held 1.047s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126f592f-6c34-490f-860b-e6d3edaa19c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1835794106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ced65d-df10-4923-ae50-4e96f76561d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:11Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846d3d94-36c4-41f3-992e-65f2edb37a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846d3d94-36c4-41f3-992e-65f2edb37a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4a10d6-4f19-45be-94da-5aeffa5f6a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4a10d6-4f19-45be-94da-5aeffa5f6a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ced65d-df10-4923-ae50-4e96f76561d8', 'volume_name': 'volume-f9ced65d-df10-4923-ae50-4e96f76561d8', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88c10ec-4ef8-475c-b563-eaa3d8cebb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88c10ec-4ef8-475c-b563-eaa3d8cebb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd177ad-b9c8-4b0c-85c9-15e53f16e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:11 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Volume f9ced65d-df10-4923-ae50-4e96f76561d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ced65d-df10-4923-ae50-4e96f76561d8', 'volume_size': 1} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Created reservations ['7468a344-9850-4cb5-a7c2-fcc51221ab4e', 'd7029fd7-6e1d-47e8-9bcb-3892003aa922', '5c363143-b4ec-4c9d-a6f6-627611404b29', '37e1d9c2-21d5-4a42-a300-175d7c7fa298'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:11 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb 1G" returned: 0 in 0.586s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:11 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb Apr 10 16:21:11 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:11 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:11 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:11 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0f02b9bc-16e3-47d2-a7a6-34dce476a873 tempest-VolumesGetTest-1222723237 None] Lock "cinder-ccb9f660-57d0-4ec0-9cc6-35aeea257959-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:11 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:11 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb is being set with open permissions: ugo+rw Apr 10 16:21:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:11 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb Apr 10 16:21:11 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:12 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:12 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info Apr 10 16:21:12 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (15c99be5-15e6-4d04-bc9d-c8e832001ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539e0119-2c8a-4548-8c18-a8b49bbd0624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539e0119-2c8a-4548-8c18-a8b49bbd0624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-968088561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98427337-7ea9-460b-a9ff-01836f2a2c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:12Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e7f901-e167-41d3-afee-8e7ee96d2ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e7f901-e167-41d3-afee-8e7ee96d2ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b65c60-7e55-46db-9d69-f942d53e6f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b65c60-7e55-46db-9d69-f942d53e6f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98427337-7ea9-460b-a9ff-01836f2a2c90', 'volume_name': 'volume-98427337-7ea9-460b-a9ff-01836f2a2c90', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e464cb05-e21a-4fef-aa38-2eed0b154f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e464cb05-e21a-4fef-aa38-2eed0b154f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef136e9-4e04-4eb8-af06-7203cf460fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:12 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Volume 98427337-7ea9-460b-a9ff-01836f2a2c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98427337-7ea9-460b-a9ff-01836f2a2c90', 'volume_size': 1} Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:12 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info" returned: 0 in 0.436s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:12 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info is being set with open permissions: ugo+rw Apr 10 16:21:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:12 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info Apr 10 16:21:12 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:13 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.info" returned: 0 in 0.400s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1835794106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ced65d-df10-4923-ae50-4e96f76561d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:11Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Creating volume f9ced65d-df10-4923-ae50-4e96f76561d8 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:13 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:13 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 1073741824 Apr 10 16:21:13 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-25cd8741-5b5e-4c30-9a08-d8d89536b226 tempest-SnapshotDependencyTests-1486398920 None] Create snapshot completed successfully Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Flow 'volume_create_manager' (1798aaad-4611-4158-99bf-5f2fe1c32d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63875b6-e038-4d02-9b34-16fd9d285623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63875b6-e038-4d02-9b34-16fd9d285623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea12e76-f81a-4b66-a404-0a07adbbc4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47db37b7ab4f43fba9462c40463f8225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03f28f3b-0f67-4efd-815e-df9ec37283cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:14Z,use_quota=True,user_id='c0ff38dd247e4b24a5dfa31d502cd7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cfd7ec-6ff3-4b61-9be5-65e376a873c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cfd7ec-6ff3-4b61-9be5-65e376a873c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a79451-f7fe-4829-ad10-0e32ebd2f0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a79451-f7fe-4829-ad10-0e32ebd2f0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fea12e76-f81a-4b66-a404-0a07adbbc4a3', 'volume_name': 'volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3', 'volume_size': 1, 'snapshot_id': '03f28f3b-0f67-4efd-815e-df9ec37283cb'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a10745a-3ba5-4bcf-8353-7d2cf49d8f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a10745a-3ba5-4bcf-8353-7d2cf49d8f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:13 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8880a3-7702-4591-ab96-19e7d3c78ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:13 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Volume fea12e76-f81a-4b66-a404-0a07adbbc4a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3', 'volume_size': 1, 'snapshot_id': '03f28f3b-0f67-4efd-815e-df9ec37283cb'} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 1073741824" returned: 0 in 0.562s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:13 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 Apr 10 16:21:13 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:14 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8" returned: 0 in 0.406s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.538s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-968088561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98427337-7ea9-460b-a9ff-01836f2a2c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:12Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Creating volume 98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:14 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd177ad-b9c8-4b0c-85c9-15e53f16e388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ced65d-df10-4923-ae50-4e96f76561d8', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:14 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 1073741824 Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd64193f-4928-428e-96bc-5ee1a9e3ce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:14 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:14 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Volume volume-f9ced65d-df10-4923-ae50-4e96f76561d8 (f9ced65d-df10-4923-ae50-4e96f76561d8): created successfully Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd64193f-4928-428e-96bc-5ee1a9e3ce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (3f279e38-5005-4dcb-9713-3522e6315733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:14 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d655d7af-1f7c-4fcb-9743-4d87ce88976e tempest-VolumesActionsTest-241540850 None] Created volume successfully. Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-f9ced65d-df10-4923-ae50-4e96f76561d8-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Lock "cinder-f9ced65d-df10-4923-ae50-4e96f76561d8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-quobyte-f9ced65d-df10-4923-ae50-4e96f76561d8" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-f9ced65d-df10-4923-ae50-4e96f76561d8" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dab36f-7201-46a0-bb3c-e211e78da12a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:14 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 Apr 10 16:21:14 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:14 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 1073741824" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:14 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:14 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:14 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8" returned: 0 in 0.505s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:14 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8 Apr 10 16:21:14 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:15 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.414s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.389s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-quobyte-03f28f3b-0f67-4efd-815e-df9ec37283cb-fea12e76-f81a-4b66-a404-0a07adbbc4a3" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef136e9-4e04-4eb8-af06-7203cf460fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98427337-7ea9-460b-a9ff-01836f2a2c90', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ffe6e6-5918-4406-ac1a-2ee666b327de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:15 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Volume volume-98427337-7ea9-460b-a9ff-01836f2a2c90 (98427337-7ea9-460b-a9ff-01836f2a2c90): created successfully Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ffe6e6-5918-4406-ac1a-2ee666b327de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (15c99be5-15e6-4d04-bc9d-c8e832001ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-03f28f3b-0f67-4efd-815e-df9ec37283cb-fea12e76-f81a-4b66-a404-0a07adbbc4a3" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Creating volume fea12e76-f81a-4b66-a404-0a07adbbc4a3 from snapshot 03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-quobyte-fea12e76-f81a-4b66-a404-0a07adbbc4a3" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-416bf86f-e3ce-49eb-ab4e-900e39169cc4 tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-fea12e76-f81a-4b66-a404-0a07adbbc4a3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] snapshot: 03f28f3b-0f67-4efd-815e-df9ec37283cb, volume: fea12e76-f81a-4b66-a404-0a07adbbc4a3, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee2973-063d-4358-91a7-8f6414c185a7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:15 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb Apr 10 16:21:15 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:15 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f9ced65d-df10-4923-ae50-4e96f76561d8" returned: 0 in 0.421s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-f9ced65d-df10-4923-ae50-4e96f76561d8" released by "delete_volume" :: held 0.953s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:15 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:15 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Created reservations ['d9de7221-1db2-474d-a636-ee501cfb143d', '945de2cf-408f-4af5-9a63-deb31840ede4', '3a3d144e-7b46-43c8-b95d-f4571d6c7de7', '1a566698-6356-48bb-88c5-897bd3d73f3d'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:15 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:15 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:15 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb" returned: 0 in 0.491s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c044de-77fb-4cb8-abba-0a4d3c46dcc7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:15 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:15 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:15 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.507s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:15 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.482s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Deleted volume successfully. Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (6c271232-c326-4e69-86a6-fd1d2b10dc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d244df-fb04-4a0b-90a4-2e3eba903a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d244df-fb04-4a0b-90a4-2e3eba903a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-289392140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bc532b-5302-429c-94f4-418662cb8cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=98427337-7ea9-460b-a9ff-01836f2a2c90,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:16Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97cfd67-b722-48f5-ba8c-232c87344ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97cfd67-b722-48f5-ba8c-232c87344ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52566ab-b1bc-4413-9b07-204183b0562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e8f0c039-5297-48c4-96a7-d40fce3b8eec tempest-VolumesActionsTest-832468973 None] Lock "cinder-f9ced65d-df10-4923-ae50-4e96f76561d8-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52566ab-b1bc-4413-9b07-204183b0562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e7bc532b-5302-429c-94f4-418662cb8cfd', 'volume_name': 'volume-e7bc532b-5302-429c-94f4-418662cb8cfd', 'volume_size': 1, 'source_volid': '98427337-7ea9-460b-a9ff-01836f2a2c90', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738dfd6d-bc4d-4222-bd85-fc4524b8ef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738dfd6d-bc4d-4222-bd85-fc4524b8ef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f145d87e-4568-410a-8b6f-65c0db484b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:16 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Volume e7bc532b-5302-429c-94f4-418662cb8cfd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e7bc532b-5302-429c-94f4-418662cb8cfd', 'volume_size': 1, 'source_volid': '98427337-7ea9-460b-a9ff-01836f2a2c90', 'source_volstatus': 'available'} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:16 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:16 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 Apr 10 16:21:16 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (82088da5-3316-4afb-88f4-5137a96f1402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6291cf3-3797-4196-b46d-602eda2c0852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6291cf3-3797-4196-b46d-602eda2c0852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1324590642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:17Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7b8cd2-63d9-4cf3-aee3-dcf256175bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7b8cd2-63d9-4cf3-aee3-dcf256175bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647f1c74-c7b8-40db-b30c-39cf380ca695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647f1c74-c7b8-40db-b30c-39cf380ca695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf', 'volume_name': 'volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cadc9f4-e5de-49b7-b237-2f4911f4289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cadc9f4-e5de-49b7-b237-2f4911f4289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cf81d2-1aac-42a8-acc4-5c7fd9284cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Volume 10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf', 'volume_size': 1} Apr 10 16:21:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:18 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3" returned: 0 in 2.107s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:18 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527cdae-1110-40f5-9578-01a53d283ae0]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:18 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:18 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:18 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.607s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:18 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:21:18 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Converted 1024.00 MB image at 485.70 MB/s Apr 10 16:21:18 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 is being set with open permissions: ugo+rw Apr 10 16:21:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:18 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 Apr 10 16:21:18 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:19 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3" returned: 0 in 0.402s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-fea12e76-f81a-4b66-a404-0a07adbbc4a3" released by "_copy_volume_from_snapshot" :: held 4.169s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-03f28f3b-0f67-4efd-815e-df9ec37283cb-fea12e76-f81a-4b66-a404-0a07adbbc4a3" released by "_create_volume_from_snapshot" :: held 4.194s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.230s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.221s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:19 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Cloning volume 98427337-7ea9-460b-a9ff-01836f2a2c90 to volume e7bc532b-5302-429c-94f4-418662cb8cfd Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8880a3-7702-4591-ab96-19e7d3c78ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3', 'volume_size': 1, 'snapshot_id': '03f28f3b-0f67-4efd-815e-df9ec37283cb'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7b40a1-e049-49d9-83a5-4bba2a3b0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Creating offline snapshot a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 of volume 98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:21:19 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Volume volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 (fea12e76-f81a-4b66-a404-0a07adbbc4a3): created successfully Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7b40a1-e049-49d9-83a5-4bba2a3b0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Flow 'volume_create_manager' (1798aaad-4611-4158-99bf-5f2fe1c32d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ad7af1-755b-4e61-8403-d13d8a8c3570]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3a6e3153-885f-4429-a68c-4cfa55970b44 tempest-SnapshotDependencyTests-1486398920 None] Created volume successfully. Apr 10 16:21:19 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:19 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:19 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.512s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:19 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 1G Apr 10 16:21:19 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-03f28f3b-0f67-4efd-815e-df9ec37283cb-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-03f28f3b-0f67-4efd-815e-df9ec37283cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-quobyte-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-quobyte-03f28f3b-0f67-4efd-815e-df9ec37283cb" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-03f28f3b-0f67-4efd-815e-df9ec37283cb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Deleting offline snapshot 03f28f3b-0f67-4efd-815e-df9ec37283cb of volume 910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] snapshot_file for this snap is: volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb09415-a8d9-44d0-88ff-7bd401d6b36f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:20 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb Apr 10 16:21:20 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:20 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 1G" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98427337-7ea9-460b-a9ff-01836f2a2c90 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:20 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98427337-7ea9-460b-a9ff-01836f2a2c90 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 Apr 10 16:21:20 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:20 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb" returned: 0 in 0.490s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1eeff2-ab6f-458d-80e5-ea531d057431]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:20 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:20 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:20 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98427337-7ea9-460b-a9ff-01836f2a2c90 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" returned: 0 in 0.427s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:20 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 is being set with open permissions: ugo+rw Apr 10 16:21:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:20 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 Apr 10 16:21:20 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:21 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.498s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:21 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb Apr 10 16:21:21 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:21 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" returned: 0 in 0.431s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:21 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info Apr 10 16:21:21 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:21 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:21 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb Apr 10 16:21:21 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:21 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info" returned: 0 in 0.467s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:21 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info is being set with open permissions: ugo+rw Apr 10 16:21:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:21 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info Apr 10 16:21:21 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:22 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4.03f28f3b-0f67-4efd-815e-df9ec37283cb" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-03f28f3b-0f67-4efd-815e-df9ec37283cb" released by "_delete_snapshot" :: held 1.913s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" released by "delete_snapshot" :: held 1.926s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Created reservations ['631118e2-5580-4562-8528-1031e22774ce', '6a7e153f-e700-477d-ba20-599bd5e7e70f', 'bb531564-a17a-4165-8376-92e95a07a3cf', '0f195775-103c-4fde-80d3-2802e2d86597'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:22 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.info" returned: 0 in 0.423s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-e7bc532b-5302-429c-94f4-418662cb8cfd" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-e7bc532b-5302-429c-94f4-418662cb8cfd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] snapshot: a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3, volume: e7bc532b-5302-429c-94f4-418662cb8cfd, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfedf69-767f-46fc-8901-bae16f5ca23e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:22 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Delete snapshot completed successfully. Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8279572a-e0dc-4198-8277-40202211c215 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-03f28f3b-0f67-4efd-815e-df9ec37283cb-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-quobyte-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:22 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 Apr 10 16:21:22 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3558bf-9d1c-499e-a2a1-1e4414af22f3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:22 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:22 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:22 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" returned: 0 in 0.508s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98427337-7ea9-460b-a9ff-01836f2a2c90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[20691d01-6b79-451b-974f-8d01facea84d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:22 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:22 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:22 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.486s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:22 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4 Apr 10 16:21:22 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:23 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.475s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:23 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd Apr 10 16:21:23 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:23 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4" released by "delete_volume" :: held 0.957s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Created reservations ['492bc63a-5297-4ff2-93d0-a99dea060346', 'eb0947de-9725-4d70-9bde-4b06cfb6429b', 'c1d74c26-90d3-491d-9ea1-3cb8800e9748', '4aad564d-2aa2-4563-a9cb-87cbaa736d0a'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:23 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:23 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-fea12e76-f81a-4b66-a404-0a07adbbc4a3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-fea12e76-f81a-4b66-a404-0a07adbbc4a3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "cinder-quobyte-fea12e76-f81a-4b66-a404-0a07adbbc4a3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-fea12e76-f81a-4b66-a404-0a07adbbc4a3" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[55974144-fd78-49d3-8c51-b6e83b8270b2]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:23 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 Apr 10 16:21:23 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:24 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3" returned: 0 in 0.677s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:24 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3 Apr 10 16:21:24 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:24 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.086s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Deleted volume successfully. Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c605f4c4-e3e3-4bfc-9661-0dbc21e935cb tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-910e4c8a-d4b8-4bde-8abc-1eca2cf669a4-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:24 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-fea12e76-f81a-4b66-a404-0a07adbbc4a3" returned: 0 in 0.670s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-quobyte-fea12e76-f81a-4b66-a404-0a07adbbc4a3" released by "delete_volume" :: held 1.380s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Created reservations ['6c531e2e-fc1b-4138-a215-26c671bba349', 'eecf31cf-6a41-4467-b128-238fff6d7b1c', 'f34cd38d-4c38-48ed-bd1c-8bcd4af9fb17', 'd3b630e1-4936-4341-a971-a0aa11ff2dcd'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:25 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:25 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:25 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd" returned: 0 in 2.208s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e4fa6-63d5-4e4b-ac7f-f3a68959fd08]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:25 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:25 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:25 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.661s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:25 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Deleted volume successfully. Apr 10 16:21:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1c2f1b54-8c6b-4ecc-9973-a4ed1927cab1 tempest-SnapshotDependencyTests-1486398920 None] Lock "cinder-fea12e76-f81a-4b66-a404-0a07adbbc4a3-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:26 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.655s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:21:26 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Converted 1024.00 MB image at 463.35 MB/s Apr 10 16:21:26 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd is being set with open permissions: ugo+rw Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:26 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd Apr 10 16:21:26 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:26 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-e7bc532b-5302-429c-94f4-418662cb8cfd" released by "_copy_volume_from_snapshot" :: held 4.363s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Deleting offline snapshot a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 of volume 98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] snapshot_file for this snap is: volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[806dac0e-663f-4339-ab89-f9c95ab21b3d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:26 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 Apr 10 16:21:26 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:27 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" returned: 0 in 0.562s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98427337-7ea9-460b-a9ff-01836f2a2c90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:21:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e5ecad-7c07-4441-aae0-62dd923aae6c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:27 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:27 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:27 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.520s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:27 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 Apr 10 16:21:27 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:28 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" returned: 0 in 0.554s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:28 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3 Apr 10 16:21:28 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:28 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90.a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-a0fc1aa3-4223-41af-b7d6-bfbd90cd8af3" released by "_delete_snapshot" :: held 2.139s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.406s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.624s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1324590642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:17Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Creating volume 10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:28 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f145d87e-4568-410a-8b6f-65c0db484b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bc532b-5302-429c-94f4-418662cb8cfd', 'volume_size': 1, 'source_volid': '98427337-7ea9-460b-a9ff-01836f2a2c90', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d80967-2fe2-4545-a92e-86cf3303cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:28 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf 1073741824 Apr 10 16:21:28 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:28 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Volume volume-e7bc532b-5302-429c-94f4-418662cb8cfd (e7bc532b-5302-429c-94f4-418662cb8cfd): created successfully Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d80967-2fe2-4545-a92e-86cf3303cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (6c271232-c326-4e69-86a6-fd1d2b10dc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:28 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-99b61028-9b21-4709-90ba-3c40d1a7ea63 tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:29 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf 1073741824" returned: 0 in 0.566s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:29 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf Apr 10 16:21:29 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:29 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf" returned: 0 in 0.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cf81d2-1aac-42a8-acc4-5c7fd9284cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369b9b8b-fb62-4ef3-9365-a27e66ba7e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Volume volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf (10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf): created successfully Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369b9b8b-fb62-4ef3-9365-a27e66ba7e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (82088da5-3316-4afb-88f4-5137a96f1402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-73a4d91c-e126-4f54-a11b-85ae7c37c06c tempest-VolumesActionsTest-241540850 None] Created volume successfully. Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Lock "cinder-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-quobyte-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb3fa5d-2e01-4f0e-b03b-42a5da87ac31]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:30 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf Apr 10 16:21:30 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (8369d2ba-b120-44ff-9c7b-adc8e5d563a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b343f0-a728-4c32-b650-6c461b888d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b343f0-a728-4c32-b650-6c461b888d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-162854280',display_name='tempest-VolumesGetTest-Volume-2081083355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83252d52-c904-4177-a4ff-a11ff85a39a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:30Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d3fdb3-a535-4524-9dd3-ee61c7820b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d3fdb3-a535-4524-9dd3-ee61c7820b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c3be4a-895d-4b62-850d-ef1d1af3c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c3be4a-895d-4b62-850d-ef1d1af3c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83252d52-c904-4177-a4ff-a11ff85a39a3', 'volume_name': 'volume-83252d52-c904-4177-a4ff-a11ff85a39a3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0543201c-b703-4524-b274-268ea28364a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0543201c-b703-4524-b274-268ea28364a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f02f79-9653-486e-b4a7-56665740910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:30 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Volume 83252d52-c904-4177-a4ff-a11ff85a39a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83252d52-c904-4177-a4ff-a11ff85a39a3', 'volume_size': 1} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-162854280',display_name='tempest-VolumesGetTest-Volume-2081083355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83252d52-c904-4177-a4ff-a11ff85a39a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:30Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Creating volume 83252d52-c904-4177-a4ff-a11ff85a39a3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:30 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:30 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 1073741824 Apr 10 16:21:30 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:30 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf" returned: 0 in 0.608s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:30 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf Apr 10 16:21:30 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:30 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 1073741824" returned: 0 in 0.559s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:31 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 Apr 10 16:21:31 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:31 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf" returned: 0 in 0.522s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf" released by "delete_volume" :: held 1.170s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Created reservations ['779611ec-e646-4e10-8ee7-d1655a1cd245', 'e6f6e402-cd58-4799-ab3f-4d196cb526f6', '59825b6b-844e-43c5-bde5-fac2bf051e05', '8a3acf6b-e5e6-4c10-865b-214bc5a3a82d'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:31 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:31 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:31 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3" returned: 0 in 0.508s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f02f79-9653-486e-b4a7-56665740910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83252d52-c904-4177-a4ff-a11ff85a39a3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f9c7b6-5417-493b-8e3a-85cf7bd96ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:31 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Volume volume-83252d52-c904-4177-a4ff-a11ff85a39a3 (83252d52-c904-4177-a4ff-a11ff85a39a3): created successfully Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f9c7b6-5417-493b-8e3a-85cf7bd96ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (8369d2ba-b120-44ff-9c7b-adc8e5d563a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:31 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0493e172-a6c5-41f6-ade1-0eba6fc5a612 tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:31 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:31 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Deleted volume successfully. Apr 10 16:21:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b105b867-91d7-4cdf-9e86-52ec97d78d16 tempest-VolumesActionsTest-832468973 None] Lock "cinder-10b06760-c9ef-4e68-a0eb-e01b6d7aa4bf-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (b93be046-da95-4f94-b0c9-bfe809cdc5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92067772-b13d-479c-8725-9516f52d3e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92067772-b13d-479c-8725-9516f52d3e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-809279086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d496ad-0a90-47a3-a15a-7066536e33e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:32Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fb56cf-fb8c-4f3d-abc6-b9743d452c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fb56cf-fb8c-4f3d-abc6-b9743d452c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3c9cb9-9252-46cf-a173-ae6ebbaf29c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3c9cb9-9252-46cf-a173-ae6ebbaf29c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d496ad-0a90-47a3-a15a-7066536e33e5', 'volume_name': 'volume-96d496ad-0a90-47a3-a15a-7066536e33e5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e000380d-10f8-43df-ae32-45fc2fd69e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e000380d-10f8-43df-ae32-45fc2fd69e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecce225-7f5a-4d21-bca1-05241bc9f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:32 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Volume 96d496ad-0a90-47a3-a15a-7066536e33e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d496ad-0a90-47a3-a15a-7066536e33e5', 'volume_size': 1} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-809279086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d496ad-0a90-47a3-a15a-7066536e33e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:32Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Creating volume 96d496ad-0a90-47a3-a15a-7066536e33e5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:32 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-83252d52-c904-4177-a4ff-a11ff85a39a3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Lock "cinder-83252d52-c904-4177-a4ff-a11ff85a39a3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:32 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 1073741824 Apr 10 16:21:32 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-83252d52-c904-4177-a4ff-a11ff85a39a3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-83252d52-c904-4177-a4ff-a11ff85a39a3" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[96838bb0-16a2-4d31-8d42-fa2c98f52ecf]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:32 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 Apr 10 16:21:32 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:33 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 1073741824" returned: 0 in 0.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:33 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 Apr 10 16:21:33 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:33 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3" returned: 0 in 0.497s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:33 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3 Apr 10 16:21:33 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:33 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5" returned: 0 in 0.407s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecce225-7f5a-4d21-bca1-05241bc9f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d496ad-0a90-47a3-a15a-7066536e33e5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d22dc7-7766-48c1-95fb-307f5e8ccfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:33 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Volume volume-96d496ad-0a90-47a3-a15a-7066536e33e5 (96d496ad-0a90-47a3-a15a-7066536e33e5): created successfully Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d22dc7-7766-48c1-95fb-307f5e8ccfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (b93be046-da95-4f94-b0c9-bfe809cdc5b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c67c55b8-cd86-4ac9-91c2-c577725e093a tempest-VolumesActionsTest-241540850 None] Created volume successfully. Apr 10 16:21:33 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-83252d52-c904-4177-a4ff-a11ff85a39a3" returned: 0 in 0.453s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-83252d52-c904-4177-a4ff-a11ff85a39a3" released by "delete_volume" :: held 0.973s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Created reservations ['6490bc29-b643-4e1e-9dec-7949d0bfc92a', '733acca0-f407-4872-8b43-31cd4a06afde', 'bfb3adb9-a6b3-4556-a120-45d3ced810ce', '0eb1d3ef-cbfd-4848-9213-cd455f934cd9'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:33 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:33 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:34 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.392s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aa2474c1-743b-49b1-aa8a-9a16d3415840 tempest-VolumesGetTest-1222723237 None] Lock "cinder-83252d52-c904-4177-a4ff-a11ff85a39a3-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-96d496ad-0a90-47a3-a15a-7066536e33e5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Lock "cinder-96d496ad-0a90-47a3-a15a-7066536e33e5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-quobyte-96d496ad-0a90-47a3-a15a-7066536e33e5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-e7bc532b-5302-429c-94f4-418662cb8cfd-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-96d496ad-0a90-47a3-a15a-7066536e33e5" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Lock "cinder-e7bc532b-5302-429c-94f4-418662cb8cfd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852f21d-cb48-4451-b1aa-cc00c0f3888f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-e7bc532b-5302-429c-94f4-418662cb8cfd" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-e7bc532b-5302-429c-94f4-418662cb8cfd" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3014a1ff-90ac-4b84-b36f-6514a89a105f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:34 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 Apr 10 16:21:34 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:34 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd Apr 10 16:21:34 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:35 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5" returned: 0 in 0.466s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:35 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5 Apr 10 16:21:35 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:35 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd" returned: 0 in 0.468s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:35 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd Apr 10 16:21:35 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:35 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-96d496ad-0a90-47a3-a15a-7066536e33e5" returned: 0 in 0.409s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-96d496ad-0a90-47a3-a15a-7066536e33e5" released by "delete_volume" :: held 0.908s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Created reservations ['41f333a8-84ff-43cb-812d-b77c87d03480', '18a8afb6-e24d-4ed5-848f-46d92403ea03', 'e8cac37e-0a96-40c6-acc0-f531f83e943c', '4d5fc15b-5533-471f-a5aa-dbf5caebde1b'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:35 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e7bc532b-5302-429c-94f4-418662cb8cfd" returned: 0 in 0.412s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-e7bc532b-5302-429c-94f4-418662cb8cfd" released by "delete_volume" :: held 0.906s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Created reservations ['93b57ca7-95bc-4565-a76a-54d605ae2e30', '525ff5c3-99ff-4277-bb96-d57effe35f5f', '6a439c72-abf2-4635-a8cc-3ecf8c7a881d', '14fa3ea7-5176-4d69-aaa2-46ae56faf58f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:35 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:35 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:35 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:35 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-98427337-7ea9-460b-a9ff-01836f2a2c90-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Lock "cinder-98427337-7ea9-460b-a9ff-01836f2a2c90-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-98427337-7ea9-460b-a9ff-01836f2a2c90" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-98427337-7ea9-460b-a9ff-01836f2a2c90" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a5cb2b-daeb-49f4-b21d-de0d935a9629]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:36 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:36 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (d85be97d-ad83-4648-be79-e2b868a4ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8773d974-bf9d-41da-b08f-fdb465100885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8773d974-bf9d-41da-b08f-fdb465100885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275401054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:36Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5323c5f8-539b-4cca-9466-15865c6ba408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5323c5f8-539b-4cca-9466-15865c6ba408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3a9425-4329-4881-bab5-e3c34d10d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3a9425-4329-4881-bab5-e3c34d10d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65', 'volume_name': 'volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fd073d-fc3f-4e38-9bd7-6727cbc57170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fd073d-fc3f-4e38-9bd7-6727cbc57170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b27f36-2025-4632-b856-0854026a82b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:36 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Volume 7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65', 'volume_size': 1} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275401054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:36Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Creating volume 7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:36 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:36 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 1073741824 Apr 10 16:21:36 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:36 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.502s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Deleted volume successfully. Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ae645ed2-5039-445b-afe6-86d2178be578 tempest-VolumesActionsTest-832468973 None] Lock "cinder-96d496ad-0a90-47a3-a15a-7066536e33e5-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:36 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.569s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7afe7def-3478-4154-ace4-24a1c9079e00 tempest-VolumesGetTest-1222723237 None] Lock "cinder-e7bc532b-5302-429c-94f4-418662cb8cfd-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:36 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.540s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:36 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90 Apr 10 16:21:36 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:36 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 1073741824" returned: 0 in 0.515s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:36 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 Apr 10 16:21:36 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:37 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-98427337-7ea9-460b-a9ff-01836f2a2c90" returned: 0 in 0.449s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-98427337-7ea9-460b-a9ff-01836f2a2c90" released by "delete_volume" :: held 1.025s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Created reservations ['f32dba2f-7582-4fce-985b-4d4e71685722', 'dbfd9b45-fb17-446d-8ad9-8e2dea95f866', 'f3f17de7-995f-41b6-bbae-881ca8512178', '982aca1e-8565-4e3f-9a9e-222e736ab14c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:37 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:37 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:37 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65" returned: 0 in 0.430s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b27f36-2025-4632-b856-0854026a82b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33afedfe-8c9b-44da-84ed-bc0c90b2e330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:37 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Volume volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 (7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65): created successfully Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33afedfe-8c9b-44da-84ed-bc0c90b2e330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (d85be97d-ad83-4648-be79-e2b868a4ae72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-985f86c5-cd3b-4765-bcad-a8947bfe7eb5 tempest-VolumesActionsTest-241540850 None] Created volume successfully. Apr 10 16:21:37 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.441s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cbfabee9-b1a0-43a4-82f7-300d992a17ef tempest-VolumesGetTest-1222723237 None] Lock "cinder-98427337-7ea9-460b-a9ff-01836f2a2c90-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Lock "cinder-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Acquiring lock "cinder-quobyte-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b689f8-50aa-4e26-ad42-2d306feedb93]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (f1ba6617-88fa-4a8b-8c98-1cd015072166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:38 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 Apr 10 16:21:38 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad5852d-2eaf-491c-922e-05e25344b7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad5852d-2eaf-491c-922e-05e25344b7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-399931465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb09be46-54f9-47ae-87a5-c35647bc9265,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:38Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1aa027-f913-4ec1-89e3-42f0ce7278dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1aa027-f913-4ec1-89e3-42f0ce7278dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c3c37d-2fd7-46c3-9ec9-9f47da8ba143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.image.glance [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Creating Keystone auth plugin from conf {{(pid=82117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c3c37d-2fd7-46c3-9ec9-9f47da8ba143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb09be46-54f9-47ae-87a5-c35647bc9265', 'volume_name': 'volume-bb09be46-54f9-47ae-87a5-c35647bc9265', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d4aab4-4aed-4005-9491-c61cca0d68b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d4aab4-4aed-4005-9491-c61cca0d68b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08552388-6271-43ba-ba71-b626e0f6d3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:38 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Volume bb09be46-54f9-47ae-87a5-c35647bc9265: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb09be46-54f9-47ae-87a5-c35647bc9265', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Trying to clone bb09be46-54f9-47ae-87a5-c35647bc9265 from image 64fc5a94-65e7-4041-898d-7b63047838a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]). {{(pid=82117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 16:21:38 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Image download 20.69 MB at 20.69 MB/s Apr 10 16:21:38 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65" returned: 0 in 0.501s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952c934-0763-44b9-9120-8af7a255725e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:38 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65 Apr 10 16:21:38 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:39 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD Apr 10 16:21:39 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:39 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65" returned: 0 in 0.400s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Lock "cinder-quobyte-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65" released by "delete_volume" :: held 0.938s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Created reservations ['711acec9-4a25-44e9-847c-1f6a6d225eba', 'd69c6c1f-957c-4e02-87c4-ec2aca2a6a2f', '086e1db6-7e0e-4813-ade3-e12e2b503b82', 'e2ce4240-326d-4df0-915b-e46ff2deaf5c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:39 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 is fetched for user 87acad2dd5fa494e99791f46bea7138b. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:39 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:39 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[83414494-a071-4eda-82c5-e38d602645bb]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:39 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD Apr 10 16:21:39 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (5f72bfcc-d550-4254-8fa5-5f949bdd2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8f403f-f053-4073-8b8c-cca04dfc75cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8f403f-f053-4073-8b8c-cca04dfc75cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33307340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb4a929-d02c-483a-9a7f-e3218cc00c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:40Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82da7c83-0e2d-4efb-a0c9-1b1dafa52918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82da7c83-0e2d-4efb-a0c9-1b1dafa52918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6029f30c-fd9b-406c-99fd-0766ac5a777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6029f30c-fd9b-406c-99fd-0766ac5a777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb4a929-d02c-483a-9a7f-e3218cc00c70', 'volume_name': 'volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8d2f38-42a3-4848-94a5-1cb307189a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8d2f38-42a3-4848-94a5-1cb307189a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3997963-6969-4887-a955-f5aa775e38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:39 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Volume 6cb4a929-d02c-483a-9a7f-e3218cc00c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70', 'volume_size': 1} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33307340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb4a929-d02c-483a-9a7f-e3218cc00c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50b7a37b60f45b586784ce45c3f2233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:40Z,use_quota=True,user_id='6bd449e4c6294a76a30c8aa67ef1df9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Creating volume 6cb4a929-d02c-483a-9a7f-e3218cc00c70 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:39 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:39 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 1073741824 Apr 10 16:21:39 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:39 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.474s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:39 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Deleted volume successfully. Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-947a0a65-02f4-41ad-afa6-5df292882d9a tempest-VolumesActionsTest-832468973 None] Lock "cinder-7d45ec4b-7dd8-4ab0-a1ed-54b41ef8bf65-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:39 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:40 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 1073741824" returned: 0 in 0.496s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:40 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 Apr 10 16:21:40 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:40 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70" returned: 0 in 0.403s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-399931465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb09be46-54f9-47ae-87a5-c35647bc9265,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:38Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Creating volume bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:40 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3997963-6969-4887-a955-f5aa775e38f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:40 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 1073741824 Apr 10 16:21:40 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebc1ae7-30df-4c07-bbd0-ce078d811f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Volume volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 (6cb4a929-d02c-483a-9a7f-e3218cc00c70): created successfully Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebc1ae7-30df-4c07-bbd0-ce078d811f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Flow 'volume_create_manager' (5f72bfcc-d550-4254-8fa5-5f949bdd2e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4d286168-02be-4f26-a2cf-2442d9e5fdc7 tempest-VolumesActionsTest-241540850 None] Created volume successfully. Apr 10 16:21:41 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 1073741824" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:41 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:41 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:41 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 0 in 0.421s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Attempting download of 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume bb09be46-54f9-47ae-87a5-c35647bc9265. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a6172-c9e3-4d93-9f6d-83afd13fbae7]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:41 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr Apr 10 16:21:41 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:42 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr" returned: 0 in 0.503s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Acquiring lock "cinder-6cb4a929-d02c-483a-9a7f-e3218cc00c70-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Lock "cinder-6cb4a929-d02c-483a-9a7f-e3218cc00c70-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:42 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr Apr 10 16:21:42 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Acquiring lock "cinder-quobyte-6cb4a929-d02c-483a-9a7f-e3218cc00c70" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Lock "cinder-quobyte-6cb4a929-d02c-483a-9a7f-e3218cc00c70" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[594bb82f-5737-453b-ab4d-307ff8d70aa8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:42 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 Apr 10 16:21:42 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:42 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr" returned: 1 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_tggtvscr' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[da837dc6-c589-4d96-a2ba-37e08ef868dc]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:42 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD Apr 10 16:21:42 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:42 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:42 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70 Apr 10 16:21:42 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:43 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] 64fc5a94-65e7-4041-898d-7b63047838a6 was qcow2, converting to raw {{(pid=82117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:43 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:43 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:43 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cb4a929-d02c-483a-9a7f-e3218cc00c70" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Lock "cinder-quobyte-6cb4a929-d02c-483a-9a7f-e3218cc00c70" released by "delete_volume" :: held 0.913s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Created reservations ['cb542d3f-7d6a-4ea7-9c1d-8cc7f89e95d6', 'cd1301d4-4149-4ba7-a893-911ffee0e068', '58d48b30-bd0b-4780-932e-58d9b61596f7', 'f6bb2554-98f1-4519-bf01-af91a1328614'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:43 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:43 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:43 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.485s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:43 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Deleted volume successfully. Apr 10 16:21:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ec0830f3-55b5-4b89-b4b3-3bf443146372 tempest-VolumesActionsTest-241540850 None] Lock "cinder-6cb4a929-d02c-483a-9a7f-e3218cc00c70-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:44 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 0 in 0.953s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:44 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_081c4sw2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:21:44 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 16:21:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:44 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 1G Apr 10 16:21:44 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:44 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 1G" returned: 0 in 0.510s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:44 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee2f36a-989c-4412-8550-d756c08c17f2]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:44 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:44 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:45 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:45 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:45 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:45 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 1 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Downloaded image 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume bb09be46-54f9-47ae-87a5-c35647bc9265 successfully. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 for user 87acad2dd5fa494e99791f46bea7138b is deleted. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Marking volume bb09be46-54f9-47ae-87a5-c35647bc9265 as bootable. {{(pid=82117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Copying metadata from image 64fc5a94-65e7-4041-898d-7b63047838a6 to bb09be46-54f9-47ae-87a5-c35647bc9265. {{(pid=82117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Creating volume glance metadata for volume bb09be46-54f9-47ae-87a5-c35647bc9265 backed by image 64fc5a94-65e7-4041-898d-7b63047838a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08552388-6271-43ba-ba71-b626e0f6d3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb09be46-54f9-47ae-87a5-c35647bc9265', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd66f980-7719-4069-ad45-0cb642e7d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:45 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Volume volume-bb09be46-54f9-47ae-87a5-c35647bc9265 (bb09be46-54f9-47ae-87a5-c35647bc9265): created successfully Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd66f980-7719-4069-ad45-0cb642e7d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (f1ba6617-88fa-4a8b-8c98-1cd015072166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f4d3d69d-549b-4002-9d0c-a322c7f2c28a tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (f1304350-4232-4da3-87ea-e640a637ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9694446f-2aad-4813-bfb6-a39c84bda9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9694446f-2aad-4813-bfb6-a39c84bda9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1598696160',display_name='tempest-VolumesGetTest-Volume-1239017782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0b3b65-1ea5-45e0-a802-ba58350671d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:47Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8c5af-c87e-4187-8d5e-d8ce294387d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8c5af-c87e-4187-8d5e-d8ce294387d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d9d82b-2586-4d86-a3f1-f0c909113ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d9d82b-2586-4d86-a3f1-f0c909113ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0b3b65-1ea5-45e0-a802-ba58350671d1', 'volume_name': 'volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68846f09-885c-477b-bd5a-506b1b94b080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68846f09-885c-477b-bd5a-506b1b94b080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fbe5d0-5ec2-4f0a-a95f-336a7b2c2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:47 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Volume 2d0b3b65-1ea5-45e0-a802-ba58350671d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1', 'volume_size': 1} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1598696160',display_name='tempest-VolumesGetTest-Volume-1239017782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0b3b65-1ea5-45e0-a802-ba58350671d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e848b4b58434f3892dd0e08fba43655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:47Z,use_quota=True,user_id='87acad2dd5fa494e99791f46bea7138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Creating volume 2d0b3b65-1ea5-45e0-a802-ba58350671d1 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:47 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:47 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 1073741824 Apr 10 16:21:47 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:48 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 1073741824" returned: 0 in 0.532s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:48 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 Apr 10 16:21:48 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:48 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1" returned: 0 in 0.481s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fbe5d0-5ec2-4f0a-a95f-336a7b2c2aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a006bdc3-a680-47a2-bdd2-6704ea350a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:48 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Volume volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 (2d0b3b65-1ea5-45e0-a802-ba58350671d1): created successfully Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a006bdc3-a680-47a2-bdd2-6704ea350a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:48 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Flow 'volume_create_manager' (f1304350-4232-4da3-87ea-e640a637ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:48 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3779d2a6-9557-41e2-8c96-351eb22a499f tempest-VolumesGetTest-1222723237 None] Created volume successfully. Apr 10 16:21:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-2d0b3b65-1ea5-45e0-a802-ba58350671d1-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Lock "cinder-2d0b3b65-1ea5-45e0-a802-ba58350671d1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-2d0b3b65-1ea5-45e0-a802-ba58350671d1" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-2d0b3b65-1ea5-45e0-a802-ba58350671d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:49 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9d3f5-faaa-479d-9f86-d4f9db2ec183]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:49 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 Apr 10 16:21:49 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:50 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:50 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1 Apr 10 16:21:50 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:50 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-2d0b3b65-1ea5-45e0-a802-ba58350671d1" returned: 0 in 0.469s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-2d0b3b65-1ea5-45e0-a802-ba58350671d1" released by "delete_volume" :: held 1.003s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Created reservations ['9bf9995a-1b29-49f3-836a-629cf59fad79', '36cfc8b1-55cb-40f1-b3a8-8656d965d9cd', 'cbd8e42c-1d47-4a48-b307-4aeb0773a002', '3dce2454-4440-40a5-8da0-0a0de28d1cf7'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:50 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:50 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Flow 'volume_create_manager' (97b745c1-8ba7-4228-b8f7-ac51c931b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf62d157-36fc-4439-b0ea-eba846939d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf62d157-36fc-4439-b0ea-eba846939d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1066748233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296fa5d7-b07f-4eda-bde5-216d8efb2add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbf31a182cf4ea89ceedd18f8919008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:51Z,use_quota=True,user_id='5f73a1ebf8f449919979f6eee9d5da2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f377fa50-0f6d-4c5b-b178-84923e8c74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f377fa50-0f6d-4c5b-b178-84923e8c74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59da613-1eb0-4d98-8863-83d164666dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.image.glance [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Creating Keystone auth plugin from conf {{(pid=82117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59da613-1eb0-4d98-8863-83d164666dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '296fa5d7-b07f-4eda-bde5-216d8efb2add', 'volume_name': 'volume-296fa5d7-b07f-4eda-bde5-216d8efb2add', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c04b23-acbd-47ec-8098-f25a6f3c8c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c04b23-acbd-47ec-8098-f25a6f3c8c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fec8ff-8658-4ca0-8205-0c9ad3670c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:51 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Volume 296fa5d7-b07f-4eda-bde5-216d8efb2add: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-296fa5d7-b07f-4eda-bde5-216d8efb2add', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Trying to clone 296fa5d7-b07f-4eda-bde5-216d8efb2add from image 64fc5a94-65e7-4041-898d-7b63047838a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]). {{(pid=82117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 16:21:51 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.542s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:51 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-24039741-33a1-429d-9857-4be873ad6b2f tempest-VolumesGetTest-1222723237 None] Lock "cinder-2d0b3b65-1ea5-45e0-a802-ba58350671d1-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 16:21:51 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Image download 20.69 MB at 20.69 MB/s Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d38063-208e-434b-83ea-f164904b1778]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:51 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD Apr 10 16:21:51 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-bb09be46-54f9-47ae-87a5-c35647bc9265-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Lock "cinder-bb09be46-54f9-47ae-87a5-c35647bc9265-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:51 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 is fetched for user 5f73a1ebf8f449919979f6eee9d5da2b. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Acquiring lock "cinder-quobyte-bb09be46-54f9-47ae-87a5-c35647bc9265" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-bb09be46-54f9-47ae-87a5-c35647bc9265" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc7518f-0358-4047-979a-a3c7adc52a0e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de66b2-3bd2-4e8a-98be-97babdf4f276]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:52 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD Apr 10 16:21:52 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:52 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:52 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:52 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1066748233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296fa5d7-b07f-4eda-bde5-216d8efb2add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbf31a182cf4ea89ceedd18f8919008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:51Z,use_quota=True,user_id='5f73a1ebf8f449919979f6eee9d5da2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Creating volume 296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:52 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:52 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add 1073741824 Apr 10 16:21:52 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:52 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 0 in 0.480s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:52 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:52 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:52 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add 1073741824" returned: 0 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=189,cinder:SELECT=155,cinder:DELETE=20,cinder:INSERT=47 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:52 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 1 in 0.489s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:21:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:52 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:52 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:52 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265 Apr 10 16:21:52 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:53 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 0 in 0.432s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:53 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bb09be46-54f9-47ae-87a5-c35647bc9265" returned: 0 in 0.422s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Lock "cinder-quobyte-bb09be46-54f9-47ae-87a5-c35647bc9265" released by "delete_volume" :: held 1.433s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Attempting download of 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume 296fa5d7-b07f-4eda-bde5-216d8efb2add. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Created reservations ['1794af54-e4b6-4fe3-b997-e0f74737e597', 'd7883f84-fe49-48b3-8aa8-602aa235cdd5', '90230338-bb7d-4cc9-b4c7-79ee8e752a2b', '383da0ab-0090-4608-850e-673e64140fd7'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592c0d0-1c30-4cb1-a493-1c4ad42877ad]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:53 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:53 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:53 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3 Apr 10 16:21:53 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:53 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:53 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.399s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3" returned: 0 in 0.450s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Deleted volume successfully. Apr 10 16:21:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-88bfbec2-b140-4a02-8b7a-48481be5e14b tempest-VolumesGetTest-1222723237 None] Lock "cinder-bb09be46-54f9-47ae-87a5-c35647bc9265-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:53 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3 Apr 10 16:21:53 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:54 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3" returned: 1 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6__b6mafi3' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df9ee67-9a17-4541-9bd5-0148af3ec4ec]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:54 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD Apr 10 16:21:54 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:54 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] 64fc5a94-65e7-4041-898d-7b63047838a6 was qcow2, converting to raw {{(pid=82117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 16:21:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:54 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:54 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:55 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 0 in 0.867s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_wykt7t20devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:21:55 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:55 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add 1G Apr 10 16:21:55 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=154,cinder:INSERT=67,cinder:UPDATE=233,cinder:DELETE=15 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (0c013ba2-a8f6-45c6-9fae-0832341cbb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f666df1f-4d0b-48ff-80bc-1cfd9dff3ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f666df1f-4d0b-48ff-80bc-1cfd9dff3ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1872333455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0ca5a5-0c29-4a05-b730-e23903bf9fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aeb423298a447088df42e83fb8663e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:56Z,use_quota=True,user_id='b244f739558541d193e37d5e60e78e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b48275-fb68-4c6f-9d6d-107b8d4645d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b48275-fb68-4c6f-9d6d-107b8d4645d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ac9cdf-4975-4771-a312-c7bdada5a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ac9cdf-4975-4771-a312-c7bdada5a58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0ca5a5-0c29-4a05-b730-e23903bf9fd3', 'volume_name': 'volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06e78c0-ef1b-4a89-b0d2-0dc1aa53ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06e78c0-ef1b-4a89-b0d2-0dc1aa53ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2305f152-32e1-4dd1-aa94-df71ac5318e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:55 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Volume 4a0ca5a5-0c29-4a05-b730-e23903bf9fd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3', 'volume_size': 1} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1872333455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0ca5a5-0c29-4a05-b730-e23903bf9fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aeb423298a447088df42e83fb8663e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:21:56Z,use_quota=True,user_id='b244f739558541d193e37d5e60e78e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Creating volume 4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:21:55 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:21:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:56 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 1073741824 Apr 10 16:21:56 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:56 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add 1G" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf06a8-0d6b-459b-844a-75ef3433ff26]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:56 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:56 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:56 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 1073741824" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:56 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:21:56 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:56 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 0 in 0.501s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:56 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:56 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:56 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.422s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2305f152-32e1-4dd1-aa94-df71ac5318e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4242cebc-46d6-44ce-b13e-822c6ab326dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:56 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Volume volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 (4a0ca5a5-0c29-4a05-b730-e23903bf9fd3): created successfully Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4242cebc-46d6-44ce-b13e-822c6ab326dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:56 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (0c013ba2-a8f6-45c6-9fae-0832341cbb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0bff19b3-bce2-4e37-b3ea-a43d78305b26 tempest-VolumeDependencyTests-2031388828 None] Created volume successfully. Apr 10 16:21:57 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 1 in 0.468s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Downloaded image 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume 296fa5d7-b07f-4eda-bde5-216d8efb2add successfully. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 for user 5f73a1ebf8f449919979f6eee9d5da2b is deleted. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Marking volume 296fa5d7-b07f-4eda-bde5-216d8efb2add as bootable. {{(pid=82117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Copying metadata from image 64fc5a94-65e7-4041-898d-7b63047838a6 to 296fa5d7-b07f-4eda-bde5-216d8efb2add. {{(pid=82117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Creating volume glance metadata for volume 296fa5d7-b07f-4eda-bde5-216d8efb2add backed by image 64fc5a94-65e7-4041-898d-7b63047838a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fec8ff-8658-4ca0-8205-0c9ad3670c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296fa5d7-b07f-4eda-bde5-216d8efb2add', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f763643-9d0a-41c4-846a-b0886b4000fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:21:57 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Volume volume-296fa5d7-b07f-4eda-bde5-216d8efb2add (296fa5d7-b07f-4eda-bde5-216d8efb2add): created successfully Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f763643-9d0a-41c4-846a-b0886b4000fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Flow 'volume_create_manager' (97b745c1-8ba7-4228-b8f7-ac51c931b720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:21:57 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d95d17ec-aa65-426a-970a-37fa5f28de23 tempest-VolumesImageMetadata-479376870 None] Created volume successfully. Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Acquiring lock "cinder-296fa5d7-b07f-4eda-bde5-216d8efb2add-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Lock "cinder-296fa5d7-b07f-4eda-bde5-216d8efb2add-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Acquiring lock "cinder-quobyte-296fa5d7-b07f-4eda-bde5-216d8efb2add" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Lock "cinder-quobyte-296fa5d7-b07f-4eda-bde5-216d8efb2add" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[87791bc8-4b51-43ec-90f3-a8b8cdb17157]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:57 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:57 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Creating offline snapshot 2012a414-3d5f-4f36-b161-892bdf9e53aa of volume 4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242e4ab-03db-4af5-a578-26c6d71b3bc0]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:58 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:58 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:21:58 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:58 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:58 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:58 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.478s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:58 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa 1G Apr 10 16:21:58 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:58 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 1 in 0.489s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:21:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:58 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add Apr 10 16:21:58 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:59 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa 1G" returned: 0 in 0.485s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:59 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-296fa5d7-b07f-4eda-bde5-216d8efb2add" returned: 0 in 0.419s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:59 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa Apr 10 16:21:59 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Lock "cinder-quobyte-296fa5d7-b07f-4eda-bde5-216d8efb2add" released by "delete_volume" :: held 1.485s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Created reservations ['377d9124-99f4-4316-9d6f-bd35c45949fa', 'd9ae64b4-155e-44d5-bae8-18dbde27a6fa', 'd560f4a0-393d-43ae-a2e4-a19a45fafb03', '79ae6489-0b48-472a-9221-ab427dbb0d71'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:59 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:21:59 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:59 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:59 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa is being set with open permissions: ugo+rw Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:21:59 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa Apr 10 16:21:59 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:21:59 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.412s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:21:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Deleted volume successfully. Apr 10 16:21:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bb0b58ee-d63d-4b14-bc7e-cf2c1ed26f43 tempest-VolumesImageMetadata-479376870 None] Lock "cinder-296fa5d7-b07f-4eda-bde5-216d8efb2add-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:00 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:00 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info Apr 10 16:22:00 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:00 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info" returned: 0 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:00 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info is being set with open permissions: ugo+rw Apr 10 16:22:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:00 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info Apr 10 16:22:00 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:00 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.info" returned: 0 in 0.428s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:00 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e5a01077-8865-4731-a20c-9179affefc7e tempest-VolumeDependencyTests-2031388828 None] Create snapshot completed successfully Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (7599d21b-6da4-44a8-a726-dc726aad7f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fa370e-2636-4314-b622-a625c5625fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fa370e-2636-4314-b622-a625c5625fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1335164269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c731171d-ce11-486b-86ca-8ff0f7f9f97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aeb423298a447088df42e83fb8663e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2012a414-3d5f-4f36-b161-892bdf9e53aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:02Z,use_quota=True,user_id='b244f739558541d193e37d5e60e78e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03048f0-2490-406b-b97c-8c9aa38f0ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03048f0-2490-406b-b97c-8c9aa38f0ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d6d75e-cc3e-4883-929d-aa2519be006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d6d75e-cc3e-4883-929d-aa2519be006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c731171d-ce11-486b-86ca-8ff0f7f9f97f', 'volume_name': 'volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f', 'volume_size': 1, 'snapshot_id': '2012a414-3d5f-4f36-b161-892bdf9e53aa'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e57147-0795-4b7a-b22c-b3912073dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e57147-0795-4b7a-b22c-b3912073dc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570d5b99-0e99-47c3-9c84-da7cd7a517ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:01 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Volume c731171d-ce11-486b-86ca-8ff0f7f9f97f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f', 'volume_size': 1, 'snapshot_id': '2012a414-3d5f-4f36-b161-892bdf9e53aa'} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-2012a414-3d5f-4f36-b161-892bdf9e53aa-c731171d-ce11-486b-86ca-8ff0f7f9f97f" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-2012a414-3d5f-4f36-b161-892bdf9e53aa-c731171d-ce11-486b-86ca-8ff0f7f9f97f" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Creating volume c731171d-ce11-486b-86ca-8ff0f7f9f97f from snapshot 2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-c731171d-ce11-486b-86ca-8ff0f7f9f97f" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c731171d-ce11-486b-86ca-8ff0f7f9f97f" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] snapshot: 2012a414-3d5f-4f36-b161-892bdf9e53aa, volume: c731171d-ce11-486b-86ca-8ff0f7f9f97f, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ec374f-f830-4060-a9bd-d84dc79b3ec9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:01 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa Apr 10 16:22:01 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:02 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e1b1f-efe0-441b-adf2-54c8303c0dd6]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:02 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:22:02 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:02 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.578s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:22:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:02 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f Apr 10 16:22:02 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Flow 'volume_create_manager' (9152b7e8-5908-4cd2-bdb1-8e7a363ada89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6751ecb-ab89-4c00-957d-6c76b2dfc362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6751ecb-ab89-4c00-957d-6c76b2dfc362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-399245730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb296722-ceab-421a-8ca8-6f4f1acb5a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1439fb053439ca6a7951d9081f0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:04Z,use_quota=True,user_id='7c36112453f24aabb5975108ec29da41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75af71a0-3209-46f0-861f-7a4325cccd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75af71a0-3209-46f0-861f-7a4325cccd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f211170-4e4e-4adc-93bb-8eba2498c4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f211170-4e4e-4adc-93bb-8eba2498c4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb296722-ceab-421a-8ca8-6f4f1acb5a07', 'volume_name': 'volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92d2ee3-c1ba-4fb1-90dc-7d28e7bd0afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92d2ee3-c1ba-4fb1-90dc-7d28e7bd0afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ffe58c-f00a-4699-a8eb-0e4b0d02dc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Volume cb296722-ceab-421a-8ca8-6f4f1acb5a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07', 'volume_size': 1} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:04 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f" returned: 0 in 2.043s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa4b6fc-7166-4f13-aa7f-a8d14932ce30]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:04 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:22:04 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:05 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.573s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:22:05 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Converted 1024.00 MB image at 500.94 MB/s Apr 10 16:22:05 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f is being set with open permissions: ugo+rw Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:05 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f Apr 10 16:22:05 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:05 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f" returned: 0 in 0.399s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c731171d-ce11-486b-86ca-8ff0f7f9f97f" released by "_copy_volume_from_snapshot" :: held 4.160s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-2012a414-3d5f-4f36-b161-892bdf9e53aa-c731171d-ce11-486b-86ca-8ff0f7f9f97f" released by "_create_volume_from_snapshot" :: held 4.178s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.186s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-399245730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb296722-ceab-421a-8ca8-6f4f1acb5a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1439fb053439ca6a7951d9081f0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:04Z,use_quota=True,user_id='7c36112453f24aabb5975108ec29da41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Creating volume cb296722-ceab-421a-8ca8-6f4f1acb5a07 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:05 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:05 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 1073741824 Apr 10 16:22:05 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570d5b99-0e99-47c3-9c84-da7cd7a517ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f', 'volume_size': 1, 'snapshot_id': '2012a414-3d5f-4f36-b161-892bdf9e53aa'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202cb1b3-8acc-45d2-b883-b58bfd9da850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Volume volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f (c731171d-ce11-486b-86ca-8ff0f7f9f97f): created successfully Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202cb1b3-8acc-45d2-b883-b58bfd9da850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (7599d21b-6da4-44a8-a726-dc726aad7f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8b2f7fa5-73ca-4003-8968-ce8d0b95f42e tempest-VolumeDependencyTests-2031388828 None] Created volume successfully. Apr 10 16:22:06 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 1073741824" returned: 0 in 0.476s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:06 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 Apr 10 16:22:06 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:06 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07" returned: 0 in 0.414s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ffe58c-f00a-4699-a8eb-0e4b0d02dc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75f2dd3-822f-4c2e-a84d-e3c60b36c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:06 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Volume volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 (cb296722-ceab-421a-8ca8-6f4f1acb5a07): created successfully Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75f2dd3-822f-4c2e-a84d-e3c60b36c501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Flow 'volume_create_manager' (9152b7e8-5908-4cd2-bdb1-8e7a363ada89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-997d2ff0-a76f-4998-9d7a-29a552bbdd0c tempest-VolumesTransfersTest-1840438479 None] Created volume successfully. Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-2012a414-3d5f-4f36-b161-892bdf9e53aa-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-2012a414-3d5f-4f36-b161-892bdf9e53aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-2012a414-3d5f-4f36-b161-892bdf9e53aa" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-2012a414-3d5f-4f36-b161-892bdf9e53aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Deleting offline snapshot 2012a414-3d5f-4f36-b161-892bdf9e53aa of volume 4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] snapshot_file for this snap is: volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[80851f10-30e6-4d80-bfc5-a141de96f764]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:07 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa Apr 10 16:22:07 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:07 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa" returned: 0 in 0.476s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:07 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17619f-2d76-4326-a2f4-2535e1b38318]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:07 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:22:07 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:07 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-588bcb1f-782a-49a6-86fe-2478bc272d7a tempest-VolumesTransfersTest-1740036341 None] Transfer volume completed successfully. Apr 10 16:22:08 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.542s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:08 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa Apr 10 16:22:08 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:08 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa" returned: 0 in 0.460s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:08 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa Apr 10 16:22:08 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Acquiring lock "cinder-cb296722-ceab-421a-8ca8-6f4f1acb5a07-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Lock "cinder-cb296722-ceab-421a-8ca8-6f4f1acb5a07-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Acquiring lock "cinder-quobyte-cb296722-ceab-421a-8ca8-6f4f1acb5a07" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Lock "cinder-quobyte-cb296722-ceab-421a-8ca8-6f4f1acb5a07" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[05753106-815f-45c1-87e9-3b466afa142c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:08 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 Apr 10 16:22:08 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:08 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3.2012a414-3d5f-4f36-b161-892bdf9e53aa" returned: 0 in 0.492s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-2012a414-3d5f-4f36-b161-892bdf9e53aa" released by "_delete_snapshot" :: held 2.022s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:08 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" released by "delete_snapshot" :: held 2.038s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Created reservations ['d8326e09-3fad-4d43-81d1-a5aebc29d865', '257279cc-7d8d-43e0-bb88-c7c4881584c6', 'cc52b222-26f0-48d6-87dd-4b5ad1fd5079', '797ad55f-ba13-4d74-b496-b53c8b090c88'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Delete snapshot completed successfully. Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8a9b4d57-b030-437d-8256-43ce7544c4c9 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-2012a414-3d5f-4f36-b161-892bdf9e53aa-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:09 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07" returned: 0 in 0.512s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:09 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07 Apr 10 16:22:09 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:09 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-cb296722-ceab-421a-8ca8-6f4f1acb5a07" returned: 0 in 0.405s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Lock "cinder-quobyte-cb296722-ceab-421a-8ca8-6f4f1acb5a07" released by "delete_volume" :: held 0.939s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Created reservations ['e2fd8e84-2bd9-44bc-a1ba-eaa3546374e1', '26d11a7c-fefd-45d0-89b3-0678550550ec', '82e9649c-b677-46fb-910c-d7b055f519fd', '50ee77a9-6e4c-4590-81d2-4415fd8c82b5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:09 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:09 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Flow 'volume_create_manager' (488ddf55-c3f4-48b6-8575-71a7a2f582c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8986de5f-997d-4033-a70d-36651e857efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8986de5f-997d-4033-a70d-36651e857efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1038379676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8dedd5-4783-4a2f-a96f-a1ffa462c61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1439fb053439ca6a7951d9081f0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:10Z,use_quota=True,user_id='7c36112453f24aabb5975108ec29da41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75602d26-6a3a-40ad-80ff-fe6c2e5e8aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75602d26-6a3a-40ad-80ff-fe6c2e5e8aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3967552-85e5-46e0-b4eb-1ad61ac796ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3967552-85e5-46e0-b4eb-1ad61ac796ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8dedd5-4783-4a2f-a96f-a1ffa462c61f', 'volume_name': 'volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d39004-ecc1-4878-9e6e-71b219831f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d39004-ecc1-4878-9e6e-71b219831f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c6e1c5-55e6-498d-bf16-4c7cbc634745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:10 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Volume af8dedd5-4783-4a2f-a96f-a1ffa462c61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f', 'volume_size': 1} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1038379676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8dedd5-4783-4a2f-a96f-a1ffa462c61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1439fb053439ca6a7951d9081f0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:10Z,use_quota=True,user_id='7c36112453f24aabb5975108ec29da41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Creating volume af8dedd5-4783-4a2f-a96f-a1ffa462c61f {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:10 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:10 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f 1073741824 Apr 10 16:22:10 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62f0172-7a2f-410b-ac5b-d4c1eec0d09d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:10 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.510s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:10 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Deleted volume successfully. Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b62964bf-20a7-4c13-a6e5-b3d6ffeb17ef tempest-VolumesTransfersTest-622608098 None] Lock "cinder-cb296722-ceab-421a-8ca8-6f4f1acb5a07-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:10 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:22:10 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:10 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f 1073741824" returned: 0 in 0.523s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:10 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f Apr 10 16:22:10 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:10 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:10 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3 Apr 10 16:22:10 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:11 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f" returned: 0 in 0.418s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c6e1c5-55e6-498d-bf16-4c7cbc634745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3ff2b4-35e7-4f26-adbc-657d499dbd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:11 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Volume volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f (af8dedd5-4783-4a2f-a96f-a1ffa462c61f): created successfully Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3ff2b4-35e7-4f26-adbc-657d499dbd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Flow 'volume_create_manager' (488ddf55-c3f4-48b6-8575-71a7a2f582c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-64487323-6e20-4e78-bdf4-29ff8f647b69 tempest-VolumesTransfersTest-1840438479 None] Created volume successfully. Apr 10 16:22:11 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" returned: 0 in 0.412s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3" released by "delete_volume" :: held 0.968s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Created reservations ['704a0060-65a5-4bb5-baf2-ab38c296500f', 'ceca31f6-b49d-4994-bc9e-ba8b1197d14a', 'fa7e5112-0bf4-4ee9-a1a2-7b8f44aaf035', '37f3f543-31b3-4628-89ee-3914777eba5b'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:11 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:11 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:11 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.394s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Deleted volume successfully. Apr 10 16:22:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-aaf6d485-33c4-410c-a745-8fa7ebce01f0 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-4a0ca5a5-0c29-4a05-b730-e23903bf9fd3-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Acquiring lock "cinder-af8dedd5-4783-4a2f-a96f-a1ffa462c61f-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Lock "cinder-af8dedd5-4783-4a2f-a96f-a1ffa462c61f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Acquiring lock "cinder-quobyte-af8dedd5-4783-4a2f-a96f-a1ffa462c61f" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Lock "cinder-quobyte-af8dedd5-4783-4a2f-a96f-a1ffa462c61f" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df96b3c-7377-4c4c-a78e-71ae36533fb9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:12 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f Apr 10 16:22:12 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (6529a7e7-c723-47ec-ac7a-ce616a94cb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55173bf6-e901-4897-82d0-51420580dcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55173bf6-e901-4897-82d0-51420580dcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-695524504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cf2c90-5db5-4c21-b5d9-1725e7d9e837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aeb423298a447088df42e83fb8663e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:12Z,use_quota=True,user_id='b244f739558541d193e37d5e60e78e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df6422d-dfa0-42a2-b96f-792aa4afa1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df6422d-dfa0-42a2-b96f-792aa4afa1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0978dd-2f31-451e-b2fc-98323bcf0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0978dd-2f31-451e-b2fc-98323bcf0706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'volume_name': 'volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44a7b33-5ff5-4c39-a9f2-602f1fd28ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44a7b33-5ff5-4c39-a9f2-602f1fd28ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b46bc4-1062-4827-a5a5-165a7e769a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:12 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Volume 38cf2c90-5db5-4c21-b5d9-1725e7d9e837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'volume_size': 1} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-695524504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cf2c90-5db5-4c21-b5d9-1725e7d9e837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aeb423298a447088df42e83fb8663e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:12Z,use_quota=True,user_id='b244f739558541d193e37d5e60e78e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Creating volume 38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:12 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:12 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 1073741824 Apr 10 16:22:12 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:12 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f" returned: 0 in 0.477s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:12 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f Apr 10 16:22:12 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:13 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 1073741824" returned: 0 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:13 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:13 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:13 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af8dedd5-4783-4a2f-a96f-a1ffa462c61f" returned: 0 in 0.439s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Lock "cinder-quobyte-af8dedd5-4783-4a2f-a96f-a1ffa462c61f" released by "delete_volume" :: held 0.939s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Created reservations ['05ec4f87-38f8-4821-bb36-f99b8f271cfd', 'c32a609f-ffe7-4352-a399-d462caf93c03', 'bb103525-7e25-4032-9e53-0ac680000485', '944f16dc-ce0c-4175-a326-e1bd9b634980'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:13 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:13 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:13 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.445s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b46bc4-1062-4827-a5a5-165a7e769a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40447c7-987d-465b-ac27-5a9a3eb12f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:13 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Volume volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 (38cf2c90-5db5-4c21-b5d9-1725e7d9e837): created successfully Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40447c7-987d-465b-ac27-5a9a3eb12f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (6529a7e7-c723-47ec-ac7a-ce616a94cb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5f069600-f2eb-4be8-8ee0-e5b88acc365f tempest-VolumeDependencyTests-2031388828 None] Created volume successfully. Apr 10 16:22:13 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.465s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Deleted volume successfully. Apr 10 16:22:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7c4ab1-086e-494a-88f9-d5f7628f89db tempest-VolumesTransfersTest-622608098 None] Lock "cinder-af8dedd5-4783-4a2f-a96f-a1ffa462c61f-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (6c90c4c8-7dd9-4c9d-b036-6663c8f5862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbded6c-b537-49d5-8ab5-92773ab64e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbded6c-b537-49d5-8ab5-92773ab64e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1664588046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19ebc3a-5b80-465e-8670-cc402422675c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aeb423298a447088df42e83fb8663e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=38cf2c90-5db5-4c21-b5d9-1725e7d9e837,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:15Z,use_quota=True,user_id='b244f739558541d193e37d5e60e78e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9643fd4c-c7c1-444e-bedf-7e1dac281603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9643fd4c-c7c1-444e-bedf-7e1dac281603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bcf95c-2412-4a40-b769-1af7a9f990ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bcf95c-2412-4a40-b769-1af7a9f990ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c19ebc3a-5b80-465e-8670-cc402422675c', 'volume_name': 'volume-c19ebc3a-5b80-465e-8670-cc402422675c', 'volume_size': 1, 'source_volid': '38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2955a2f5-2e89-417c-bd29-bf862fd165bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2955a2f5-2e89-417c-bd29-bf862fd165bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a62ed4-93a1-41cf-8428-fb1d9fa1ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:14 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Volume c19ebc3a-5b80-465e-8670-cc402422675c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c19ebc3a-5b80-465e-8670-cc402422675c', 'volume_size': 1, 'source_volid': '38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'source_volstatus': 'available'} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:14 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Cloning volume 38cf2c90-5db5-4c21-b5d9-1725e7d9e837 to volume c19ebc3a-5b80-465e-8670-cc402422675c Apr 10 16:22:14 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Creating offline snapshot ab310924-68d0-4df8-a884-f0e2a907f488 of volume 38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724f159-ef72-4c77-a83b-f2dfc9ea7912]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:15 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:15 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:15 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:15 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:15 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.554s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:15 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 1G Apr 10 16:22:15 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:15 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:16 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 1G" returned: 0 in 0.531s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:16 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 Apr 10 16:22:16 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:16 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488" returned: 0 in 0.484s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:16 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 is being set with open permissions: ugo+rw Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:16 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 Apr 10 16:22:16 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Flow 'volume_create_manager' (2bd27f73-448b-4059-bfe9-cb705543295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a25f858-cec7-49ca-b0e0-d6814a2db752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a25f858-cec7-49ca-b0e0-d6814a2db752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2053499330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a6fdfd-f4b8-4d10-aed6-de484c972ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6135957efda348cbad12dff0fb1cf5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:17Z,use_quota=True,user_id='912f77f9cf734e2d849959be461669fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757fd44a-aa09-4453-b1f1-b42278cd631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757fd44a-aa09-4453-b1f1-b42278cd631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f09687-d3b8-4c47-bbc1-e414895be1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f09687-d3b8-4c47-bbc1-e414895be1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'volume_name': 'volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bde05e-68f8-4032-a5ee-c3d198998598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bde05e-68f8-4032-a5ee-c3d198998598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15966905-4b3b-4a98-8b76-8665e4775678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:16 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Volume 82a6fdfd-f4b8-4d10-aed6-de484c972ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'volume_size': 1} Apr 10 16:22:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:17 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:17 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info Apr 10 16:22:17 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:17 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info" returned: 0 in 0.421s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:17 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info is being set with open permissions: ugo+rw Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:17 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info Apr 10 16:22:17 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:17 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.info" returned: 0 in 0.413s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-c19ebc3a-5b80-465e-8670-cc402422675c" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c19ebc3a-5b80-465e-8670-cc402422675c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] snapshot: ab310924-68d0-4df8-a884-f0e2a907f488, volume: c19ebc3a-5b80-465e-8670-cc402422675c, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d44405-a345-4b11-b0a7-b8cc99cd9881]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:17 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 Apr 10 16:22:17 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:18 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b898381-fc9e-48fa-b19d-0e744365872b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:18 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:18 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:18 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.466s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:22:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:18 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c Apr 10 16:22:18 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:20 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c" returned: 0 in 1.781s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:20 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec347182-78c7-4499-8d66-bf56301caed4]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:20 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:20 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:21 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.574s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837, size 1024.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:22:21 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Converted 1024.00 MB image at 574.51 MB/s Apr 10 16:22:21 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c is being set with open permissions: ugo+rw Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:21 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c Apr 10 16:22:21 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:21 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c" returned: 0 in 0.404s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c19ebc3a-5b80-465e-8670-cc402422675c" released by "_copy_volume_from_snapshot" :: held 3.731s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-ab310924-68d0-4df8-a884-f0e2a907f488" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-ab310924-68d0-4df8-a884-f0e2a907f488" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Deleting offline snapshot ab310924-68d0-4df8-a884-f0e2a907f488 of volume 38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] snapshot_file for this snap is: volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4375bfd5-4e8f-4507-9b7d-bbafb8f57b13]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:21 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 Apr 10 16:22:21 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:22 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ce625-4af9-46cc-a97b-9dd12ef3021b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:22 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:22 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:22 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:22 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 Apr 10 16:22:22 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:22 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488" returned: 0 in 0.431s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:22 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488 Apr 10 16:22:22 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:23 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837.ab310924-68d0-4df8-a884-f0e2a907f488" returned: 0 in 0.394s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-ab310924-68d0-4df8-a884-f0e2a907f488" released by "_delete_snapshot" :: held 1.765s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.446s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.634s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2053499330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a6fdfd-f4b8-4d10-aed6-de484c972ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6135957efda348cbad12dff0fb1cf5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:17Z,use_quota=True,user_id='912f77f9cf734e2d849959be461669fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Creating volume 82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:23 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a62ed4-93a1-41cf-8428-fb1d9fa1ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19ebc3a-5b80-465e-8670-cc402422675c', 'volume_size': 1, 'source_volid': '38cf2c90-5db5-4c21-b5d9-1725e7d9e837', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae5909c-6b7e-4fbc-b204-886dfee5660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:23 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb 1073741824 Apr 10 16:22:23 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:23 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Volume volume-c19ebc3a-5b80-465e-8670-cc402422675c (c19ebc3a-5b80-465e-8670-cc402422675c): created successfully Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae5909c-6b7e-4fbc-b204-886dfee5660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Flow 'volume_create_manager' (6c90c4c8-7dd9-4c9d-b036-6663c8f5862d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:23 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-33f5e84c-d75f-4626-9daf-d817ebb72b5c tempest-VolumeDependencyTests-2031388828 None] Created volume successfully. Apr 10 16:22:23 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb 1073741824" returned: 0 in 0.451s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:23 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:23 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:24 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15966905-4b3b-4a98-8b76-8665e4775678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc878162-c0be-4911-823e-3bca74d7083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:24 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Volume volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb (82a6fdfd-f4b8-4d10-aed6-de484c972ceb): created successfully Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc878162-c0be-4911-823e-3bca74d7083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Flow 'volume_create_manager' (2bd27f73-448b-4059-bfe9-cb705543295c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e149d251-fade-4d43-8a6c-6aa153043faf tempest-VolumesCloneTest-589877482 None] Created volume successfully. Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-38cf2c90-5db5-4c21-b5d9-1725e7d9e837-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-38cf2c90-5db5-4c21-b5d9-1725e7d9e837-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b180cf-d860-49af-af3d-492d796ee4e5]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:24 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:24 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:24 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.467s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:24 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837 Apr 10 16:22:24 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:25 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-38cf2c90-5db5-4c21-b5d9-1725e7d9e837" released by "delete_volume" :: held 0.906s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Created reservations ['9ac7785a-6c41-48d6-ac03-e62d1149abdb', 'eb8b84ba-e45b-4ff6-9668-7551e44d6ea1', '2280886c-72ae-4eca-8451-0dc78abe0476', '907dc16f-9524-4025-aae9-7107613eee3e'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:25 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:25 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Flow 'volume_create_manager' (30a46fd8-6b3e-4305-b485-f8dc8781e7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9212ff-fdc4-41c1-a22e-4d51495a46f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-c19ebc3a-5b80-465e-8670-cc402422675c-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9212ff-fdc4-41c1-a22e-4d51495a46f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1742830133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d82b63-ccb9-48dc-b2fe-0d0b24605ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6135957efda348cbad12dff0fb1cf5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=82a6fdfd-f4b8-4d10-aed6-de484c972ceb,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:25Z,use_quota=True,user_id='912f77f9cf734e2d849959be461669fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daaa476-fcfa-49ae-b514-260a8897130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daaa476-fcfa-49ae-b514-260a8897130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d934b7d3-a319-4444-9a1d-7f33dfb25cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-c19ebc3a-5b80-465e-8670-cc402422675c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d934b7d3-a319-4444-9a1d-7f33dfb25cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '59d82b63-ccb9-48dc-b2fe-0d0b24605ae8', 'volume_name': 'volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8', 'volume_size': 2, 'source_volid': '82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7bf89e-3a2a-4361-a123-cd43e4ec6ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7bf89e-3a2a-4361-a123-cd43e4ec6ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9888a467-e218-46da-9e21-83f11e19e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:25 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Volume 59d82b63-ccb9-48dc-b2fe-0d0b24605ae8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8', 'volume_size': 2, 'source_volid': '82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'source_volstatus': 'available'} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:25 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Cloning volume 82a6fdfd-f4b8-4d10-aed6-de484c972ceb to volume 59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-c19ebc3a-5b80-465e-8670-cc402422675c" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c19ebc3a-5b80-465e-8670-cc402422675c" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Creating offline snapshot 9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 of volume 82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a49bff-e8ef-4fc0-87de-5772f4f08087]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a18ea4e-0aec-439b-ab7c-4f13bfa9f590]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:25 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c Apr 10 16:22:25 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:25 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:25 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:25 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Deleted volume successfully. Apr 10 16:22:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-10982259-78c8-4034-b0bb-39b533e30e31 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-38cf2c90-5db5-4c21-b5d9-1725e7d9e837-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:26 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.473s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:26 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c" returned: 0 in 0.495s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:26 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 1G Apr 10 16:22:26 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:26 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c Apr 10 16:22:26 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:26 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c19ebc3a-5b80-465e-8670-cc402422675c" returned: 0 in 0.414s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c19ebc3a-5b80-465e-8670-cc402422675c" released by "delete_volume" :: held 0.931s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:26 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Created reservations ['9bdf2cc9-5da4-43f2-85ee-418e0512cfb3', 'b01ea140-c1b8-4bb0-88bb-6408fca01025', 'fe72a811-e013-4b4d-b99f-25fd17eb0f04', 'aeb64002-d3e1-4c2f-8b49-849b969373eb'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 1G" returned: 0 in 0.485s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:26 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 Apr 10 16:22:26 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:26 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:26 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:26 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.391s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:26 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:26 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Deleted volume successfully. Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" returned: 0 in 0.445s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:27 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 is being set with open permissions: ugo+rw Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-176922c4-2908-47aa-bdc1-f3d2ca150e00 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-c19ebc3a-5b80-465e-8670-cc402422675c-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:27 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 Apr 10 16:22:27 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:27 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" returned: 0 in 0.408s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:27 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info Apr 10 16:22:27 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-c731171d-ce11-486b-86ca-8ff0f7f9f97f-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-c731171d-ce11-486b-86ca-8ff0f7f9f97f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "cinder-quobyte-c731171d-ce11-486b-86ca-8ff0f7f9f97f" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c731171d-ce11-486b-86ca-8ff0f7f9f97f" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a614b11c-1597-46f1-82c7-ed0e70eb2a17]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:27 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f Apr 10 16:22:27 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:27 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info" returned: 0 in 0.430s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:27 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info is being set with open permissions: ugo+rw Apr 10 16:22:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:27 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info Apr 10 16:22:27 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:28 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f" returned: 0 in 0.476s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:28 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f Apr 10 16:22:28 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:28 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.info" returned: 0 in 0.412s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Acquiring lock "cinder-quobyte-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] snapshot: 9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3, volume: 59d82b63-ccb9-48dc-b2fe-0d0b24605ae8, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1431f-f3f6-44d8-add6-07225cc9e765]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:28 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 Apr 10 16:22:28 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:28 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c731171d-ce11-486b-86ca-8ff0f7f9f97f" returned: 0 in 0.420s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-quobyte-c731171d-ce11-486b-86ca-8ff0f7f9f97f" released by "delete_volume" :: held 0.930s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Created reservations ['35a44cfb-6f24-4340-8b7c-9f1c07276437', '714b734e-2073-44e6-b112-d3c6ec30b598', '106037c1-94ea-4581-beff-d40d4873964f', '2f196f3c-15fb-4257-8066-e4f2905a3d8f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:28 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:28 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:28 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" returned: 0 in 0.494s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22dd0b-1d2c-49a0-a428-5df1e23bc6e8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:28 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:28 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:29 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.430s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:29 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Deleted volume successfully. Apr 10 16:22:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c868168f-b922-4d12-aa49-477023a9b0b7 tempest-VolumeDependencyTests-2031388828 None] Lock "cinder-c731171d-ce11-486b-86ca-8ff0f7f9f97f-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:29 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.537s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:29 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:22:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:29 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 Apr 10 16:22:29 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:31 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" returned: 0 in 1.814s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:31 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8396194-80bf-4ce3-a269-eb6debce521d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:31 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:31 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:31 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.587s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:31 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:22:31 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Converted 1024.00 MB image at 564.09 MB/s Apr 10 16:22:31 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 is being set with open permissions: ugo+rw Apr 10 16:22:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:31 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 Apr 10 16:22:31 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:32 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" returned: 0 in 0.389s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" released by "_copy_volume_from_snapshot" :: held 3.864s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Acquiring lock "cinder-quobyte-9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Deleting offline snapshot 9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 of volume 82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] snapshot_file for this snap is: volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8918d89-54ff-41b1-ab17-0dcbb5ca4671]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:32 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 Apr 10 16:22:32 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:32 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" returned: 0 in 0.451s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2d4f0-5b78-4e3b-8103-8e8f870d7c42]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:32 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:32 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:33 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:33 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 Apr 10 16:22:33 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:33 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" returned: 0 in 0.426s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:33 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3 Apr 10 16:22:33 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:33 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb.9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" returned: 0 in 0.395s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-9c3d48fa-0ac0-4e08-9539-fd76aeba5ad3" released by "_delete_snapshot" :: held 1.763s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.408s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9888a467-e218-46da-9e21-83f11e19e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8', 'volume_size': 2, 'source_volid': '82a6fdfd-f4b8-4d10-aed6-de484c972ceb', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61866c6-588e-4990-950b-903b5b5bb948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:33 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Volume volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 (59d82b63-ccb9-48dc-b2fe-0d0b24605ae8): created successfully Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61866c6-588e-4990-950b-903b5b5bb948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Flow 'volume_create_manager' (30a46fd8-6b3e-4305-b485-f8dc8781e7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-582ab864-b77e-4085-be73-efcaaa2ccf42 tempest-VolumesCloneTest-589877482 None] Created volume successfully. Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Acquiring lock "cinder-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Lock "cinder-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Acquiring lock "cinder-quobyte-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e92d26-e16a-4c45-b646-14717f38373d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:35 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 Apr 10 16:22:35 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:35 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" returned: 0 in 0.449s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:35 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8 Apr 10 16:22:35 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:35 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" returned: 0 in 0.387s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8" released by "delete_volume" :: held 0.861s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Created reservations ['bc7ace41-9de7-4b30-bcf4-60188316c833', '9dc3a38a-0306-4690-9fbb-ae51e0fdb311', 'a1da63e5-e526-4fa5-8cff-26598cf18a53', '8081553f-adc3-473a-921a-a55db63ea3bc'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:36 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:36 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Acquiring lock "cinder-82a6fdfd-f4b8-4d10-aed6-de484c972ceb-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Lock "cinder-82a6fdfd-f4b8-4d10-aed6-de484c972ceb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Acquiring lock "cinder-quobyte-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c26e39-d49f-4530-b48c-29b272a572d0]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:36 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:36 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:36 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Deleted volume successfully. Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d38f59b7-cb0c-437b-82d3-14e101392ff7 tempest-VolumesCloneTest-589877482 None] Lock "cinder-59d82b63-ccb9-48dc-b2fe-0d0b24605ae8-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:36 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.451s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:36 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb Apr 10 16:22:36 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:37 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" returned: 0 in 0.390s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Lock "cinder-quobyte-82a6fdfd-f4b8-4d10-aed6-de484c972ceb" released by "delete_volume" :: held 0.866s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Created reservations ['1490d643-6295-4730-b864-aa4e02860606', 'b81e6f72-05a5-4b7e-bc7d-7ff88064d127', 'eb868c42-9c68-4ed7-8ccc-e41e83aec43b', '21198af0-0ec0-44c4-a5d3-efe21a9bd585'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:37 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:37 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:37 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Deleted volume successfully. Apr 10 16:22:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2159384f-37b7-421a-a1d9-10a98fa77377 tempest-VolumesCloneTest-589877482 None] Lock "cinder-82a6fdfd-f4b8-4d10-aed6-de484c972ceb-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Flow 'volume_create_manager' (e35e3da3-8bf6-47e9-9ee9-cb0e8648cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fe1d25-6bb7-4a01-bc0f-3653334c403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fe1d25-6bb7-4a01-bc0f-3653334c403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1875044452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54b8793-eccc-43de-810f-4ff9cb163758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383af1183302424db247f11844f137e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:39Z,use_quota=True,user_id='3380b7cc16a746beb4f6bf8aa5dfa4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e65ac50-36c5-4fdc-b35b-d08d16037d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e65ac50-36c5-4fdc-b35b-d08d16037d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3ada11-fa99-4a5e-beca-5d9cc12e533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.image.glance [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Creating Keystone auth plugin from conf {{(pid=82117) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3ada11-fa99-4a5e-beca-5d9cc12e533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c54b8793-eccc-43de-810f-4ff9cb163758', 'volume_name': 'volume-c54b8793-eccc-43de-810f-4ff9cb163758', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74f2a1c-75da-4ce0-81c2-61fcc2362d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74f2a1c-75da-4ce0-81c2-61fcc2362d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cb4736-86d7-4336-9aaa-e081e7689433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:39 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Volume c54b8793-eccc-43de-810f-4ff9cb163758: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c54b8793-eccc-43de-810f-4ff9cb163758', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Trying to clone c54b8793-eccc-43de-810f-4ff9cb163758 from image 64fc5a94-65e7-4041-898d-7b63047838a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]). {{(pid=82117) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 16:22:39 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Image download 20.69 MB at 20.69 MB/s Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac0f10-276d-4c57-9fff-92c292e7efee]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:39 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD Apr 10 16:22:39 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:39 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 is fetched for user 3380b7cc16a746beb4f6bf8aa5dfa4d2. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4299a391-2b28-4454-b108-7a286b9201f5]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:39 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD Apr 10 16:22:39 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:40 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1875044452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54b8793-eccc-43de-810f-4ff9cb163758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383af1183302424db247f11844f137e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:39Z,use_quota=True,user_id='3380b7cc16a746beb4f6bf8aa5dfa4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Creating volume c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:40 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:40 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 1073741824 Apr 10 16:22:40 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:40 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 1073741824" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:40 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:40 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:41 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 0 in 0.405s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Attempting download of 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume c54b8793-eccc-43de-810f-4ff9cb163758. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af9d3ee-27b6-4df7-b78e-90bb998af6d2]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_ {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:41 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_ Apr 10 16:22:41 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:41 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_" returned: 0 in 0.449s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_ {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:41 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_ Apr 10 16:22:41 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:42 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_" returned: 1 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc5a94-65e7-4041-898d-7b63047838a6_zu4v_8v_' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded4bb1d-38a6-41ad-8712-cc69765acb44]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:42 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD Apr 10 16:22:42 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:42 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] 64fc5a94-65e7-4041-898d-7b63047838a6 was qcow2, converting to raw {{(pid=82117) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 16:22:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:42 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:42 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:43 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 0 in 0.795s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:43 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc5a94-65e7-4041-898d-7b63047838a6_irehh3s1devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:22:43 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 16:22:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:43 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 1G Apr 10 16:22:43 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:43 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 1G" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:43 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81231c-4716-457f-b071-835984b605f0]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:43 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:43 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:44 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 0 in 0.476s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:44 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:44 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:44 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 1 in 0.459s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Downloaded image 64fc5a94-65e7-4041-898d-7b63047838a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}])) to volume c54b8793-eccc-43de-810f-4ff9cb163758 successfully. {{(pid=82117) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Temporary image 64fc5a94-65e7-4041-898d-7b63047838a6 for user 3380b7cc16a746beb4f6bf8aa5dfa4d2 is deleted. {{(pid=82117) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.volume_utils [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Marking volume c54b8793-eccc-43de-810f-4ff9cb163758 as bootable. {{(pid=82117) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Copying metadata from image 64fc5a94-65e7-4041-898d-7b63047838a6 to c54b8793-eccc-43de-810f-4ff9cb163758. {{(pid=82117) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Creating volume glance metadata for volume c54b8793-eccc-43de-810f-4ff9cb163758 backed by image 64fc5a94-65e7-4041-898d-7b63047838a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82117) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cb4736-86d7-4336-9aaa-e081e7689433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54b8793-eccc-43de-810f-4ff9cb163758', 'volume_size': 1, 'image_id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc5a94-65e7-4041-898d-7b63047838a6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f1206fcb6c4940f38b35ab991c312c0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc5a94-65e7-4041-898d-7b63047838a6', 'created_at': datetime.datetime(2026, 4, 10, 14, 10, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 14, 10, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc5a94-65e7-4041-898d-7b63047838a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8f611f-2445-4d6e-b95e-3cef3a7ada45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:44 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Volume volume-c54b8793-eccc-43de-810f-4ff9cb163758 (c54b8793-eccc-43de-810f-4ff9cb163758): created successfully Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8f611f-2445-4d6e-b95e-3cef3a7ada45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Flow 'volume_create_manager' (e35e3da3-8bf6-47e9-9ee9-cb0e8648cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9f5fd18d-4879-4ff8-967c-e8bf4abac529 tempest-VolumesExtendTest-1017909517 None] Created volume successfully. Apr 10 16:22:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6c7b6e-470c-4734-964e-5e25ce1f3916]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:45 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:45 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:45 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 0 in 0.483s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:45 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:45 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:46 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 1 in 0.462s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 2G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 2G" returned: 0 in 0.031s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:46 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-bd00d708-209e-45b3-a4ae-424fa51951ea tempest-VolumesExtendTest-1017909517 None] Extend volume completed successfully. Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-c54b8793-eccc-43de-810f-4ff9cb163758-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Lock "cinder-c54b8793-eccc-43de-810f-4ff9cb163758-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-quobyte-c54b8793-eccc-43de-810f-4ff9cb163758" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-c54b8793-eccc-43de-810f-4ff9cb163758" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e61321f-366e-4c4e-9a50-558967c51b1c]: (4, 'raw') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:46 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:46 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:47 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 0 in 0.459s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:47 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:47 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:47 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 1 in 0.474s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758' failed. Not Retrying. {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 16:22:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:47 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758 Apr 10 16:22:47 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:48 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-c54b8793-eccc-43de-810f-4ff9cb163758" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-c54b8793-eccc-43de-810f-4ff9cb163758" released by "delete_volume" :: held 1.390s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Created reservations ['29bc6738-6ebf-42a2-8366-7e0d866cdfea', '2be63381-ebbd-4afc-80db-e3620eeddb9d', '6df32208-1080-4d06-9369-c6d234fdb802', '916cacb4-4b6d-4d39-88c6-a211b7bce74f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:48 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:48 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:48 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.394s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:48 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Deleted volume successfully. Apr 10 16:22:48 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-516963a8-aa22-4815-8968-3d946f9ec54a tempest-VolumesExtendTest-1017909517 None] Lock "cinder-c54b8793-eccc-43de-810f-4ff9cb163758-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Flow 'volume_create_manager' (e7bd0c50-aa57-430f-8ee6-272bb79cf579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99655a37-bd31-4c4a-bbaf-9db8be660af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99655a37-bd31-4c4a-bbaf-9db8be660af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-828168037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0adb0a-5b20-4a3d-9be1-7628d0c98b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383af1183302424db247f11844f137e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:49Z,use_quota=True,user_id='3380b7cc16a746beb4f6bf8aa5dfa4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb35833-ce1d-438a-8c17-f5fa6903b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb35833-ce1d-438a-8c17-f5fa6903b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700acc7f-a45f-4660-8881-444e964618ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700acc7f-a45f-4660-8881-444e964618ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0adb0a-5b20-4a3d-9be1-7628d0c98b38', 'volume_name': 'volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f06c2aa-c808-43f2-b048-50e37fc8b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f06c2aa-c808-43f2-b048-50e37fc8b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44d4608-85f2-4c97-8a57-38034b336b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:49 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Volume af0adb0a-5b20-4a3d-9be1-7628d0c98b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38', 'volume_size': 1} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-828168037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0adb0a-5b20-4a3d-9be1-7628d0c98b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383af1183302424db247f11844f137e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:22:49Z,use_quota=True,user_id='3380b7cc16a746beb4f6bf8aa5dfa4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Creating volume af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:22:49 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:49 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 1073741824 Apr 10 16:22:49 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:49 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 1073741824" returned: 0 in 0.458s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:49 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 Apr 10 16:22:49 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:49 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" returned: 0 in 0.389s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44d4608-85f2-4c97-8a57-38034b336b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c129da32-e59a-49db-a942-14973350767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:22:49 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Volume volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 (af0adb0a-5b20-4a3d-9be1-7628d0c98b38): created successfully Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c129da32-e59a-49db-a942-14973350767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:22:49 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Flow 'volume_create_manager' (e7bd0c50-aa57-430f-8ee6-272bb79cf579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:22:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9b64395d-5ab5-4dfe-8bd7-aaadacd6f610 tempest-VolumesExtendTest-1017909517 None] Created volume successfully. Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Creating offline snapshot 9f5f713a-bced-450d-ae38-9f32e47790d2 of volume af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b32c390-8dc4-43f4-a4f1-a365503c1817]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:50 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 Apr 10 16:22:50 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:50 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" returned: 0 in 0.441s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:50 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 1G Apr 10 16:22:50 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:51 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 1G" returned: 0 in 0.443s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:51 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 Apr 10 16:22:51 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:51 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2" returned: 0 in 0.423s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:51 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 is being set with open permissions: ugo+rw Apr 10 16:22:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:51 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 Apr 10 16:22:51 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:51 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2" returned: 0 in 0.387s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:51 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info Apr 10 16:22:51 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:52 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info" returned: 0 in 0.394s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:52 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info is being set with open permissions: ugo+rw Apr 10 16:22:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:52 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info Apr 10 16:22:52 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:52 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.info" returned: 0 in 0.394s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:52 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-65735aaa-b7f6-45ad-9780-ffd9827269b7 tempest-VolumesExtendTest-1017909517 None] Create snapshot completed successfully Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e14d4-ea4e-4d3f-803c-4a99108453b8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:53 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 Apr 10 16:22:53 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:53 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 2G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 2G" returned: 0 in 0.051s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.510s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:53 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=121,cinder:SELECT=115,cinder:DELETE=11,cinder:INSERT=44 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:22:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-64192a3e-1367-42f8-9e4c-d36d577ecd18 tempest-VolumesExtendTest-1017909517 None] Extend volume completed successfully. Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-9f5f713a-bced-450d-ae38-9f32e47790d2-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-9f5f713a-bced-450d-ae38-9f32e47790d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-quobyte-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-quobyte-9f5f713a-bced-450d-ae38-9f32e47790d2" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-9f5f713a-bced-450d-ae38-9f32e47790d2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Deleting offline snapshot 9f5f713a-bced-450d-ae38-9f32e47790d2 of volume af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] snapshot_file for this snap is: volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e3c02a-025e-4f6a-9ef8-579cb98feaa5]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:54 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 Apr 10 16:22:54 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:55 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2" returned: 0 in 0.449s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b9ce67-2c86-404b-b2d4-11e22e4d7b64]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:55 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 Apr 10 16:22:55 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:55 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:55 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 Apr 10 16:22:55 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:55 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2" returned: 0 in 0.436s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:55 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2 Apr 10 16:22:55 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:56 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38.9f5f713a-bced-450d-ae38-9f32e47790d2" returned: 0 in 0.385s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=104,cinder:UPDATE=144,cinder:INSERT=40,cinder:DELETE=13 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-9f5f713a-bced-450d-ae38-9f32e47790d2" released by "_delete_snapshot" :: held 1.768s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" released by "delete_snapshot" :: held 1.780s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Created reservations ['1f174356-89ae-4228-80f0-6e54dbef20c9', 'dc3d30c5-b9a5-489b-84f2-365764945f11', '7b611044-fa8f-4bf3-ac9e-0fdc3bf24158', '9c032f55-b0a6-4e30-8a5d-a6e20cb9e412'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Delete snapshot completed successfully. Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-2f867ed9-8d8e-466b-a1d4-5af57c49db89 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-9f5f713a-bced-450d-ae38-9f32e47790d2-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-af0adb0a-5b20-4a3d-9be1-7628d0c98b38-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-af0adb0a-5b20-4a3d-9be1-7628d0c98b38-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "cinder-quobyte-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" acquired by "delete_volume" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ddb217-683a-4dda-8e4a-a4a53962dfe7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:22:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:56 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 Apr 10 16:22:56 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:57 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" returned: 0 in 0.439s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:57 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38 Apr 10 16:22:57 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:57 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" returned: 0 in 0.386s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-quobyte-af0adb0a-5b20-4a3d-9be1-7628d0c98b38" released by "delete_volume" :: held 0.856s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Created reservations ['8282b322-411b-41c2-8ba9-a38683abb1d5', '9faced41-508a-46a7-a737-7563abc27d4f', 'df26b8d4-62a1-438c-abac-664df69052e6', '771dd173-a684-45ce-8c12-0ede278f0321'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:22:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:22:57 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:22:57 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:22:58 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 10 16:22:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:22:58 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:22:58 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Deleted volume successfully. Apr 10 16:22:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1abac255-8ce6-42f5-85b3-faf0fd1e5df5 tempest-VolumesExtendTest-1017909517 None] Lock "cinder-af0adb0a-5b20-4a3d-9be1-7628d0c98b38-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (3f9aa06f-14af-4a65-aab6-daab90da4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34d32d9-0173-421d-8c95-7257ca1319a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34d32d9-0173-421d-8c95-7257ca1319a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1724399105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8552dc4-5d0d-458d-a723-dbc148ac7e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:04Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17eddde-fcf5-482b-b5ca-b0abc1e472f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17eddde-fcf5-482b-b5ca-b0abc1e472f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04721aa0-ba1c-482f-8f82-e1e80ab3178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04721aa0-ba1c-482f-8f82-e1e80ab3178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8552dc4-5d0d-458d-a723-dbc148ac7e6d', 'volume_name': 'volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a74610-16bc-4ad1-a0bb-024342dc086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a74610-16bc-4ad1-a0bb-024342dc086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9bf85b-b477-4b8c-9307-3e6a117067c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Volume f8552dc4-5d0d-458d-a723-dbc148ac7e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d', 'volume_size': 1} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1724399105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8552dc4-5d0d-458d-a723-dbc148ac7e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:04Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Creating volume f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:04 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:04 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d 1073741824 Apr 10 16:23:04 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:04 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d 1073741824" returned: 0 in 0.488s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:04 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d Apr 10 16:23:04 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:05 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" returned: 0 in 0.417s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9bf85b-b477-4b8c-9307-3e6a117067c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356611d6-6146-48f0-ad4e-8e2df51ef993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Volume volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d (f8552dc4-5d0d-458d-a723-dbc148ac7e6d): created successfully Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356611d6-6146-48f0-ad4e-8e2df51ef993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (3f9aa06f-14af-4a65-aab6-daab90da4b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-2aeb9ace-32b7-4207-922c-862e2e900ea4 tempest-VolumesSnapshotTestJSON-866523748 None] Created volume successfully. Apr 10 16:23:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Creating offline snapshot 0c79a155-45a2-4f01-8205-9c56d8e45ea4 of volume f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:23:06 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7004ab2-5a6d-41d3-872f-b838b62329d3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:06 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d Apr 10 16:23:06 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:07 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" returned: 0 in 0.456s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:07 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 1G Apr 10 16:23:07 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:07 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 1G" returned: 0 in 0.481s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:07 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 Apr 10 16:23:07 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:08 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4" returned: 0 in 0.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:08 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 is being set with open permissions: ugo+rw Apr 10 16:23:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:08 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 Apr 10 16:23:08 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:08 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4" returned: 0 in 0.391s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:08 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info Apr 10 16:23:08 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:08 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info" returned: 0 in 0.405s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:08 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info is being set with open permissions: ugo+rw Apr 10 16:23:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:08 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info Apr 10 16:23:08 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:09 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.info" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:09 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-417a91a1-4feb-4e50-b37b-b4586066583c tempest-VolumesSnapshotTestJSON-866523748 None] Create snapshot completed successfully Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-0c79a155-45a2-4f01-8205-9c56d8e45ea4-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-0c79a155-45a2-4f01-8205-9c56d8e45ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-0c79a155-45a2-4f01-8205-9c56d8e45ea4" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-0c79a155-45a2-4f01-8205-9c56d8e45ea4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Deleting offline snapshot 0c79a155-45a2-4f01-8205-9c56d8e45ea4 of volume f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] snapshot_file for this snap is: volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86e62a-19b6-4636-a374-1b3ed6414873]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:09 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 Apr 10 16:23:09 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:10 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4" returned: 0 in 0.488s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:23:10 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e707b8-8957-4afb-a286-b0d0f941443c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:10 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d Apr 10 16:23:10 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:10 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:10 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 Apr 10 16:23:10 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:11 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4" returned: 0 in 0.423s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:11 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4 Apr 10 16:23:11 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:11 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d.0c79a155-45a2-4f01-8205-9c56d8e45ea4" returned: 0 in 0.390s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-0c79a155-45a2-4f01-8205-9c56d8e45ea4" released by "_delete_snapshot" :: held 1.819s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" released by "delete_snapshot" :: held 1.831s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['aac144ce-a00f-40f7-8b1c-dae5212361fe', '85c2d3ba-1b0d-4e47-8883-0f5135110acb', 'bffef0f8-f9b5-4dea-be81-c263b25c7e6f', '27173f6b-901b-40da-8af7-443738f8cd76'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Delete snapshot completed successfully. Apr 10 16:23:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-53ba47c8-788f-4a0c-8691-f6333eadca4b tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-0c79a155-45a2-4f01-8205-9c56d8e45ea4-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (203978b7-8ba5-4cc7-86a8-0080391f3d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9f6403-4ddc-48ae-8f05-521c7a2c9156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9f6403-4ddc-48ae-8f05-521c7a2c9156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1649805112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0158fe0-3860-42ef-a30e-c982b9be2d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:12Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8ba1f7-2774-4005-bd68-7cd4c2c40a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8ba1f7-2774-4005-bd68-7cd4c2c40a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd2ffa6-6fc2-453a-bd0f-4c28a730f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd2ffa6-6fc2-453a-bd0f-4c28a730f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0158fe0-3860-42ef-a30e-c982b9be2d3e', 'volume_name': 'volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373808fb-9d57-4bf4-a2e3-5c8ca2ef550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373808fb-9d57-4bf4-a2e3-5c8ca2ef550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d22fc5-a768-4536-bdf7-3b9eecba3999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:12 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Volume d0158fe0-3860-42ef-a30e-c982b9be2d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e', 'volume_size': 1} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1649805112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0158fe0-3860-42ef-a30e-c982b9be2d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:12Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Creating volume d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:12 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:12 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e 1073741824 Apr 10 16:23:12 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:12 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e 1073741824" returned: 0 in 0.460s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:12 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:12 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:13 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.407s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d22fc5-a768-4536-bdf7-3b9eecba3999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6c4523-9f27-4e3b-8de1-6cd7677cfc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:13 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Volume volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e (d0158fe0-3860-42ef-a30e-c982b9be2d3e): created successfully Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6c4523-9f27-4e3b-8de1-6cd7677cfc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (203978b7-8ba5-4cc7-86a8-0080391f3d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ecd06ed9-e979-4ade-b1b5-29bcf9e4f917 tempest-VolumesSnapshotTestJSON-866523748 None] Created volume successfully. Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Creating offline snapshot 18fb4f27-2457-41de-a9be-c4fdd528c768 of volume d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaebc71-db02-421e-a5da-85e6658099b8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:13 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:13 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:13 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.450s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:13 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 1G Apr 10 16:23:13 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:14 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 1G" returned: 0 in 0.451s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:14 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 Apr 10 16:23:14 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:14 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768" returned: 0 in 0.409s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:14 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 is being set with open permissions: ugo+rw Apr 10 16:23:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:14 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 Apr 10 16:23:14 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:15 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768" returned: 0 in 0.391s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:15 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info Apr 10 16:23:15 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:15 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:15 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:15 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info" returned: 0 in 0.403s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:15 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info is being set with open permissions: ugo+rw Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:15 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info Apr 10 16:23:15 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:15 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.387s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:15 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.info" returned: 0 in 0.398s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:15 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d2d554ad-39ca-4583-b957-9b332775b4e7 tempest-VolumesSnapshotTestJSON-866523748 None] Create snapshot completed successfully Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (e72f7ba5-2cb9-4277-ac47-4b15c771e511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02559121-060c-4446-8a7d-ff2d65649257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02559121-060c-4446-8a7d-ff2d65649257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2036856811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf847bc-3e20-486a-8c89-c5c039c81219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=18fb4f27-2457-41de-a9be-c4fdd528c768,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:17Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9566ea-e94e-4b4f-ae9c-383bda0d7c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9566ea-e94e-4b4f-ae9c-383bda0d7c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fd8acb-4381-41bc-8831-069b42ca249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fd8acb-4381-41bc-8831-069b42ca249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'acf847bc-3e20-486a-8c89-c5c039c81219', 'volume_name': 'volume-acf847bc-3e20-486a-8c89-c5c039c81219', 'volume_size': 2, 'snapshot_id': '18fb4f27-2457-41de-a9be-c4fdd528c768'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7354b671-7c0b-4fbd-aeb2-52d8d415f54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7354b671-7c0b-4fbd-aeb2-52d8d415f54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c82ff3-3134-4a0c-a184-6ea254d35b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:16 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Volume acf847bc-3e20-486a-8c89-c5c039c81219: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-acf847bc-3e20-486a-8c89-c5c039c81219', 'volume_size': 2, 'snapshot_id': '18fb4f27-2457-41de-a9be-c4fdd528c768'} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-18fb4f27-2457-41de-a9be-c4fdd528c768-acf847bc-3e20-486a-8c89-c5c039c81219" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-18fb4f27-2457-41de-a9be-c4fdd528c768-acf847bc-3e20-486a-8c89-c5c039c81219" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Creating volume acf847bc-3e20-486a-8c89-c5c039c81219 from snapshot 18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-acf847bc-3e20-486a-8c89-c5c039c81219" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-acf847bc-3e20-486a-8c89-c5c039c81219" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] snapshot: 18fb4f27-2457-41de-a9be-c4fdd528c768, volume: acf847bc-3e20-486a-8c89-c5c039c81219, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b38f640-7949-4cec-923a-7a9bd646ad87]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:16 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 Apr 10 16:23:16 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:17 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768" returned: 0 in 0.456s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a20dbd-597d-49b8-adfa-91d8b6b97e96]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:17 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:17 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:17 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.453s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:23:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:17 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 Apr 10 16:23:17 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:19 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219" returned: 0 in 1.810s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:19 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788b655-beba-4468-959c-51d6b080b0c4]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:19 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:19 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:20 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:23:20 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Converted 1024.00 MB image at 565.27 MB/s Apr 10 16:23:20 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 is being set with open permissions: ugo+rw Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:20 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 Apr 10 16:23:20 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:20 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219" returned: 0 in 0.389s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-acf847bc-3e20-486a-8c89-c5c039c81219" released by "_copy_volume_from_snapshot" :: held 3.741s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-18fb4f27-2457-41de-a9be-c4fdd528c768-acf847bc-3e20-486a-8c89-c5c039c81219" released by "_create_volume_from_snapshot" :: held 3.755s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.763s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c82ff3-3134-4a0c-a184-6ea254d35b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf847bc-3e20-486a-8c89-c5c039c81219', 'volume_size': 2, 'snapshot_id': '18fb4f27-2457-41de-a9be-c4fdd528c768'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d17d94-4208-44ec-91d6-9e4d33d7bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:20 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Volume volume-acf847bc-3e20-486a-8c89-c5c039c81219 (acf847bc-3e20-486a-8c89-c5c039c81219): created successfully Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d17d94-4208-44ec-91d6-9e4d33d7bb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (e72f7ba5-2cb9-4277-ac47-4b15c771e511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:20 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-cc3810e7-29a4-4c0a-a374-118867781c52 tempest-VolumesSnapshotTestJSON-866523748 None] Created volume successfully. Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-acf847bc-3e20-486a-8c89-c5c039c81219-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-acf847bc-3e20-486a-8c89-c5c039c81219-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-acf847bc-3e20-486a-8c89-c5c039c81219" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-acf847bc-3e20-486a-8c89-c5c039c81219" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ea8be-ebae-4f13-b1e0-a2621b35fd67]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:21 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 Apr 10 16:23:21 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:21 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219" returned: 0 in 0.467s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:21 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219 Apr 10 16:23:21 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:22 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-acf847bc-3e20-486a-8c89-c5c039c81219" returned: 0 in 0.407s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-acf847bc-3e20-486a-8c89-c5c039c81219" released by "delete_volume" :: held 0.902s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['00915047-fefd-4b04-a845-408fc63592d5', '8927c24b-3f2f-4077-86cd-3f2934b98ed6', '7ee7e678-a322-4e13-b3bc-cf7044e823ab', '0001b54d-efff-486c-9b42-5c462bbaaaa2'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:22 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:22 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-18fb4f27-2457-41de-a9be-c4fdd528c768-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-18fb4f27-2457-41de-a9be-c4fdd528c768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-d0158fe0-3860-42ef-a30e-c982b9be2d3e" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-d0158fe0-3860-42ef-a30e-c982b9be2d3e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-18fb4f27-2457-41de-a9be-c4fdd528c768" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-18fb4f27-2457-41de-a9be-c4fdd528c768" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Deleting offline snapshot 18fb4f27-2457-41de-a9be-c4fdd528c768 of volume d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] snapshot_file for this snap is: volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f1acf-7245-437e-8029-fdb0672f7e86]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:22 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 Apr 10 16:23:22 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:22 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.460s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:22 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Deleted volume successfully. Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7693b030-b856-4158-b330-f6481339ebca tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-acf847bc-3e20-486a-8c89-c5c039c81219-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:22 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768" returned: 0 in 0.501s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c41c14-9d13-4773-a73b-4a15d0017e32]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:22 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:22 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:23 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.462s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:23 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 Apr 10 16:23:23 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:23 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:23 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768 Apr 10 16:23:23 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:24 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e.18fb4f27-2457-41de-a9be-c4fdd528c768" returned: 0 in 0.387s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-18fb4f27-2457-41de-a9be-c4fdd528c768" released by "_delete_snapshot" :: held 1.851s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-d0158fe0-3860-42ef-a30e-c982b9be2d3e" released by "delete_snapshot" :: held 1.864s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['5ee17ca7-a403-4967-9e59-a83455d015a8', '871840a7-56d7-4f2c-93f5-2c769f437324', '26591b89-ea54-4a08-9b08-668276bd4cef', 'b867047a-a781-4619-867b-e80aff7fc31c'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Delete snapshot completed successfully. Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-35a2231a-d20d-400f-aba7-c3721e7a5230 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-18fb4f27-2457-41de-a9be-c4fdd528c768-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-d0158fe0-3860-42ef-a30e-c982b9be2d3e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-d0158fe0-3860-42ef-a30e-c982b9be2d3e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-d0158fe0-3860-42ef-a30e-c982b9be2d3e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-d0158fe0-3860-42ef-a30e-c982b9be2d3e" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6452866c-44ab-4f10-bc3f-41638eeb0aa5]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:24 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:24 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:24 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.456s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:24 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e Apr 10 16:23:24 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:25 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-d0158fe0-3860-42ef-a30e-c982b9be2d3e" returned: 0 in 0.385s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-d0158fe0-3860-42ef-a30e-c982b9be2d3e" released by "delete_volume" :: held 0.873s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['dfe8262d-8557-4356-bf33-6351b25d15cc', '73b4e876-a477-449f-a5ee-84eab82bca20', '77c99821-2006-4a86-917f-39a14d59bd30', 'fcd25c2e-b647-4955-82dd-ebb9047f0be1'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:25 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:25 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (81df9193-f748-4c86-a866-ddf7565ef7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7b6e56-2e5b-4803-88d1-9942cf6ecb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:25 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7b6e56-2e5b-4803-88d1-9942cf6ecb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-392926196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af88b6d8-a9b7-4b98-96fe-13d5d030c39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:26Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e295f18c-632d-43f2-8a77-6599a01e6672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e295f18c-632d-43f2-8a77-6599a01e6672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e94252b-0376-4dac-bcde-8a7ef8e11968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e94252b-0376-4dac-bcde-8a7ef8e11968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af88b6d8-a9b7-4b98-96fe-13d5d030c39b', 'volume_name': 'volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712bbfdc-f0a5-4cf8-9daa-d19a28bda33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712bbfdc-f0a5-4cf8-9daa-d19a28bda33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f6e631-675e-4d30-ac2d-79f8889bbb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:25 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Volume af88b6d8-a9b7-4b98-96fe-13d5d030c39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b', 'volume_size': 1} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-392926196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af88b6d8-a9b7-4b98-96fe-13d5d030c39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:26Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Creating volume af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:25 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.471s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:25 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Deleted volume successfully. Apr 10 16:23:25 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b 1073741824 Apr 10 16:23:25 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0b480317-a407-4907-956d-4623247cb1db tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-d0158fe0-3860-42ef-a30e-c982b9be2d3e-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:26 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b 1073741824" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:26 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:26 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:26 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.393s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f6e631-675e-4d30-ac2d-79f8889bbb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfbae25-6fb4-46fb-adfc-40da477fe2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:26 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Volume volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b (af88b6d8-a9b7-4b98-96fe-13d5d030c39b): created successfully Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfbae25-6fb4-46fb-adfc-40da477fe2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (81df9193-f748-4c86-a866-ddf7565ef7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e3bf4c63-2a06-4434-a226-72067c474fa9 tempest-VolumesSnapshotTestJSON-866523748 None] Created volume successfully. Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Creating offline snapshot 1b77c59c-7e5d-46f2-a0e3-e6398f3de682 of volume af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bbcdc4-7280-4ec9-92df-6669dac27a77]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:26 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:26 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:27 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:27 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 1G Apr 10 16:23:27 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:27 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 1G" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:27 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 Apr 10 16:23:27 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:28 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682" returned: 0 in 0.413s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:28 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 is being set with open permissions: ugo+rw Apr 10 16:23:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:28 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 Apr 10 16:23:28 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:28 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682" returned: 0 in 0.387s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:28 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info Apr 10 16:23:28 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:29 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info" returned: 0 in 0.390s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:29 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info is being set with open permissions: ugo+rw Apr 10 16:23:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:29 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info Apr 10 16:23:29 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:29 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.info" returned: 0 in 0.389s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-41f20885-bb19-4f2e-b4e2-389ebaf70d55 tempest-VolumesSnapshotTestJSON-866523748 None] Create snapshot completed successfully Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (79555cfe-bec1-4197-8ebd-da6dd4428acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5976f8de-83b8-4679-9655-42e28ae2160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5976f8de-83b8-4679-9655-42e28ae2160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-994786617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3683e82b-d65f-40ef-9bf0-bc943b95d26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcf40bac40e4b489c8386ae7fa4db10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b77c59c-7e5d-46f2-a0e3-e6398f3de682,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:30Z,use_quota=True,user_id='4fbba6fec69047e0b42c0e5176566c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3d411d-2ae9-47f9-9a71-4c6a034a51cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3d411d-2ae9-47f9-9a71-4c6a034a51cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8195b80-0f15-4d78-b2c7-415f428bd25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8195b80-0f15-4d78-b2c7-415f428bd25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3683e82b-d65f-40ef-9bf0-bc943b95d26e', 'volume_name': 'volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e', 'volume_size': 1, 'snapshot_id': '1b77c59c-7e5d-46f2-a0e3-e6398f3de682'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751bded8-90e2-49b4-b3da-b7c609b374da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751bded8-90e2-49b4-b3da-b7c609b374da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdd13b5-7534-49d1-939e-f44723fb09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:30 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Volume 3683e82b-d65f-40ef-9bf0-bc943b95d26e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e', 'volume_size': 1, 'snapshot_id': '1b77c59c-7e5d-46f2-a0e3-e6398f3de682'} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-1b77c59c-7e5d-46f2-a0e3-e6398f3de682-3683e82b-d65f-40ef-9bf0-bc943b95d26e" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-1b77c59c-7e5d-46f2-a0e3-e6398f3de682-3683e82b-d65f-40ef-9bf0-bc943b95d26e" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Creating volume 3683e82b-d65f-40ef-9bf0-bc943b95d26e from snapshot 1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-3683e82b-d65f-40ef-9bf0-bc943b95d26e" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-3683e82b-d65f-40ef-9bf0-bc943b95d26e" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] snapshot: 1b77c59c-7e5d-46f2-a0e3-e6398f3de682, volume: 3683e82b-d65f-40ef-9bf0-bc943b95d26e, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f665d901-1d9e-4db3-8131-ea6fa4a2821a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:30 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 Apr 10 16:23:30 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:30 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682" returned: 0 in 0.443s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f59f93a-7d61-4763-bcd8-9fef78220147]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:30 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:30 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:31 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.453s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:31 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:23:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:31 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e Apr 10 16:23:31 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:33 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e" returned: 0 in 1.789s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:33 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[29826298-380d-4128-99e4-8ad21ff5ec6d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:33 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:33 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:33 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:33 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:23:33 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Converted 1024.00 MB image at 572.06 MB/s Apr 10 16:23:33 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e is being set with open permissions: ugo+rw Apr 10 16:23:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:33 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e Apr 10 16:23:33 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:34 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e" returned: 0 in 0.384s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-3683e82b-d65f-40ef-9bf0-bc943b95d26e" released by "_copy_volume_from_snapshot" :: held 3.698s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-1b77c59c-7e5d-46f2-a0e3-e6398f3de682-3683e82b-d65f-40ef-9bf0-bc943b95d26e" released by "_create_volume_from_snapshot" :: held 3.713s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.721s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdd13b5-7534-49d1-939e-f44723fb09b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e', 'volume_size': 1, 'snapshot_id': '1b77c59c-7e5d-46f2-a0e3-e6398f3de682'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99e8e3a-0616-43b7-81b7-cf5cde8ee00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:34 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Volume volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e (3683e82b-d65f-40ef-9bf0-bc943b95d26e): created successfully Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99e8e3a-0616-43b7-81b7-cf5cde8ee00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Flow 'volume_create_manager' (79555cfe-bec1-4197-8ebd-da6dd4428acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-09f37716-1408-425f-82fb-c0c0e1818277 tempest-VolumesSnapshotTestJSON-866523748 None] Created volume successfully. Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-3683e82b-d65f-40ef-9bf0-bc943b95d26e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-3683e82b-d65f-40ef-9bf0-bc943b95d26e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-3683e82b-d65f-40ef-9bf0-bc943b95d26e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-3683e82b-d65f-40ef-9bf0-bc943b95d26e" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f305c4-88ac-429e-b5f9-cb3cc49d5522]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:34 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e Apr 10 16:23:34 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:35 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e" returned: 0 in 0.443s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:35 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e Apr 10 16:23:35 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:35 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-3683e82b-d65f-40ef-9bf0-bc943b95d26e" returned: 0 in 0.392s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-3683e82b-d65f-40ef-9bf0-bc943b95d26e" released by "delete_volume" :: held 0.857s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['531b0056-5c4a-4c97-879f-e241d6ad4172', '8b3fbf21-e667-4060-8e11-168331064e16', '902285c9-6d6a-47f7-b5be-f5507bd0a6ea', 'c1ead218-5945-4535-9426-4575bc0dfd55'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:35 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:35 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-1b77c59c-7e5d-46f2-a0e3-e6398f3de682-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-1b77c59c-7e5d-46f2-a0e3-e6398f3de682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-1b77c59c-7e5d-46f2-a0e3-e6398f3de682" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-1b77c59c-7e5d-46f2-a0e3-e6398f3de682" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Deleting offline snapshot 1b77c59c-7e5d-46f2-a0e3-e6398f3de682 of volume af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] snapshot_file for this snap is: volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70d16e-0bfa-47a3-872f-c831ce28d643]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:35 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 Apr 10 16:23:35 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:35 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.418s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:35 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Deleted volume successfully. Apr 10 16:23:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c6021c0e-1e21-4e7d-8e6b-9bb22599562f tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-3683e82b-d65f-40ef-9bf0-bc943b95d26e-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:36 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682" returned: 0 in 0.457s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:23:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[957c0db6-36d6-4347-86e5-01a266d71526]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:36 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:36 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:36 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:36 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 Apr 10 16:23:36 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:37 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:37 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682 Apr 10 16:23:37 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:37 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b.1b77c59c-7e5d-46f2-a0e3-e6398f3de682" returned: 0 in 0.382s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-1b77c59c-7e5d-46f2-a0e3-e6398f3de682" released by "_delete_snapshot" :: held 1.774s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" released by "delete_snapshot" :: held 1.787s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['68f7c1b8-7a26-41ad-966c-980248e88841', 'b7780d9a-4d9c-489d-ab02-4fe92048c36c', 'ba70a764-eabf-4e82-842c-f24fbe3ede74', 'c4071a25-8d8c-453f-bb73-4d9fb65bfab4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:37 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Delete snapshot completed successfully. Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-528e61cd-a7f6-4af8-8c5b-d2979ca3efe1 tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-1b77c59c-7e5d-46f2-a0e3-e6398f3de682-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-af88b6d8-a9b7-4b98-96fe-13d5d030c39b-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-af88b6d8-a9b7-4b98-96fe-13d5d030c39b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a31c52-e9bf-49db-b8be-021e6ff65892]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:37 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:37 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:38 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.448s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:38 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b Apr 10 16:23:38 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:38 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" returned: 0 in 0.387s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-af88b6d8-a9b7-4b98-96fe-13d5d030c39b" released by "delete_volume" :: held 0.872s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['7515b760-8cda-4737-bf9a-6d83c24bd887', 'ac47a1a1-59fd-46ff-b571-dc19a215cb57', 'e7806fe3-1f19-4f62-b215-7ea6e56fd8ac', 'bbed98a9-b51e-4d93-b5cf-43210e0019f5'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:38 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:38 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-f8552dc4-5d0d-458d-a723-dbc148ac7e6d-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-f8552dc4-5d0d-458d-a723-dbc148ac7e6d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "cinder-quobyte-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df9f0f9-51f1-4cd6-8b84-c832f26d70b8]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:39 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d Apr 10 16:23:39 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:39 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.429s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:39 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Deleted volume successfully. Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8f1153f9-5281-41f4-a4ae-569e81290a8e tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-af88b6d8-a9b7-4b98-96fe-13d5d030c39b-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:39 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" returned: 0 in 0.462s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:39 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d Apr 10 16:23:39 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:39 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" returned: 0 in 0.404s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-quobyte-f8552dc4-5d0d-458d-a723-dbc148ac7e6d" released by "delete_volume" :: held 0.896s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Created reservations ['0fc217de-07b5-4fed-bdd4-aba1c83c1323', 'd04e3086-d160-48c2-b5f1-c1e267e32dbb', '1c9154d0-c824-4c0f-87cc-b6a724d703f2', 'ec6719b9-e496-48aa-b8c2-93f67ec7a0f3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:39 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:39 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:40 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.432s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:40 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Deleted volume successfully. Apr 10 16:23:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c8b090bc-7cee-4f4a-97ae-3b9486fe2f7a tempest-VolumesSnapshotTestJSON-866523748 None] Lock "cinder-f8552dc4-5d0d-458d-a723-dbc148ac7e6d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Flow 'volume_create_manager' (9f82a54b-b20a-4a31-aa29-c35016c00df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f4ce05-dac0-4844-b26f-7f0262df6c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f4ce05-dac0-4844-b26f-7f0262df6c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0ca5cb-1e26-457d-9f0d-d944c19f533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c58c666aa4f21a374577591f3a56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:43Z,use_quota=True,user_id='32748aa75daa4729957c450e7e1d5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37c5905-164c-4d9f-9825-6e0a6a17ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37c5905-164c-4d9f-9825-6e0a6a17ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d0fe52-84b9-41ae-a474-e81a8241459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d0fe52-84b9-41ae-a474-e81a8241459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0ca5cb-1e26-457d-9f0d-d944c19f533e', 'volume_name': 'volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a534fac1-37a9-4729-8693-87849b15a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a534fac1-37a9-4729-8693-87849b15a004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fa7182-65ff-44be-a042-dee496494357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:43 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Volume bc0ca5cb-1e26-457d-9f0d-d944c19f533e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e', 'volume_size': 1} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0ca5cb-1e26-457d-9f0d-d944c19f533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c58c666aa4f21a374577591f3a56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:43Z,use_quota=True,user_id='32748aa75daa4729957c450e7e1d5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Creating volume bc0ca5cb-1e26-457d-9f0d-d944c19f533e {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:43 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:43 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e 1073741824 Apr 10 16:23:43 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:43 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e 1073741824" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:44 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e Apr 10 16:23:44 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:44 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e" returned: 0 in 0.386s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fa7182-65ff-44be-a042-dee496494357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d9776-1620-4d29-813d-feed9846ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:44 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Volume volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e (bc0ca5cb-1e26-457d-9f0d-d944c19f533e): created successfully Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d9776-1620-4d29-813d-feed9846ca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Flow 'volume_create_manager' (9f82a54b-b20a-4a31-aa29-c35016c00df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9a6f8c51-90dc-48f0-b98c-3b7a4487b73c tempest-CinderUnicodeTest-185972375 None] Created volume successfully. Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Flow 'volume_create_manager' (889c4a0b-1200-49d4-a36b-b6092f8ba463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b634f4e4-9271-4ff1-9709-fb660affc6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b634f4e4-9271-4ff1-9709-fb660affc6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1215498587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc92772-f233-455f-a3f3-6b2c7604afc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c58c666aa4f21a374577591f3a56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:45Z,use_quota=True,user_id='32748aa75daa4729957c450e7e1d5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddc926e-6576-43e9-9531-697585fb9f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddc926e-6576-43e9-9531-697585fb9f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f14af88-59b2-4dc4-9923-7d4e16db22ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f14af88-59b2-4dc4-9923-7d4e16db22ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc92772-f233-455f-a3f3-6b2c7604afc5', 'volume_name': 'volume-9dc92772-f233-455f-a3f3-6b2c7604afc5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdf6f30-f6b0-418f-8bfe-a255cc91444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdf6f30-f6b0-418f-8bfe-a255cc91444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cff6e5-9ab5-4743-acdc-c76d34db8b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:44 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Volume 9dc92772-f233-455f-a3f3-6b2c7604afc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc92772-f233-455f-a3f3-6b2c7604afc5', 'volume_size': 1} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:23:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1215498587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc92772-f233-455f-a3f3-6b2c7604afc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c58c666aa4f21a374577591f3a56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:23:45Z,use_quota=True,user_id='32748aa75daa4729957c450e7e1d5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Creating volume 9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:23:44 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:23:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:44 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 1073741824 Apr 10 16:23:44 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:45 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 1073741824" returned: 0 in 0.480s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:45 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 Apr 10 16:23:45 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:45 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5" returned: 0 in 0.412s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cff6e5-9ab5-4743-acdc-c76d34db8b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc92772-f233-455f-a3f3-6b2c7604afc5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f802ac9-8bdc-4bb7-ae31-482d8dc81e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:23:45 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Volume volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 (9dc92772-f233-455f-a3f3-6b2c7604afc5): created successfully Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f802ac9-8bdc-4bb7-ae31-482d8dc81e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:23:45 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Flow 'volume_create_manager' (889c4a0b-1200-49d4-a36b-b6092f8ba463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:23:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5d867d8c-daa8-482f-b123-9f3656d0ff29 tempest-CinderUnicodeTest-185972375 None] Created volume successfully. Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Creating offline snapshot 2239615e-8425-48c5-ba78-9b171eb574d6 of volume 9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbca75c5-14cf-44a2-ab93-351497bd743d]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:47 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 Apr 10 16:23:47 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:47 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5" returned: 0 in 0.450s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:47 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 1G Apr 10 16:23:47 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:47 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 1G" returned: 0 in 0.470s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:47 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 Apr 10 16:23:47 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:48 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6" returned: 0 in 0.422s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:48 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 is being set with open permissions: ugo+rw Apr 10 16:23:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:48 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 Apr 10 16:23:48 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:48 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6" returned: 0 in 0.410s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:48 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info Apr 10 16:23:48 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:49 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info" returned: 0 in 0.417s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:49 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info is being set with open permissions: ugo+rw Apr 10 16:23:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:49 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info Apr 10 16:23:49 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:49 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.info" returned: 0 in 0.391s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4bc16ccb-5a69-40c4-a5a0-b5e57472058a tempest-CinderUnicodeTest-185972375 None] Create snapshot completed successfully Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-2239615e-8425-48c5-ba78-9b171eb574d6-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Lock "cinder-2239615e-8425-48c5-ba78-9b171eb574d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-quobyte-9dc92772-f233-455f-a3f3-6b2c7604afc5" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-9dc92772-f233-455f-a3f3-6b2c7604afc5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-quobyte-2239615e-8425-48c5-ba78-9b171eb574d6" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-2239615e-8425-48c5-ba78-9b171eb574d6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Deleting offline snapshot 2239615e-8425-48c5-ba78-9b171eb574d6 of volume 9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] snapshot_file for this snap is: volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd0e5ff-c265-465f-9517-1c17b2ba9dd7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:50 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 Apr 10 16:23:50 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:50 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6" returned: 0 in 0.473s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc92772-f233-455f-a3f3-6b2c7604afc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d1b1b-be95-4977-97b2-10e583f6ae8b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:50 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 Apr 10 16:23:50 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:51 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5" returned: 0 in 0.469s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:51 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 Apr 10 16:23:51 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:51 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6" returned: 0 in 0.453s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:51 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6 Apr 10 16:23:51 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:52 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5.2239615e-8425-48c5-ba78-9b171eb574d6" returned: 0 in 0.407s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-2239615e-8425-48c5-ba78-9b171eb574d6" released by "_delete_snapshot" :: held 1.856s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-9dc92772-f233-455f-a3f3-6b2c7604afc5" released by "delete_snapshot" :: held 1.868s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Created reservations ['eff9ce5d-babe-4d00-b566-918f45108cb7', 'a734bd07-38b3-4504-95e7-515ae9566806', '9bdafd1b-93d0-4e44-b0a0-5aad09ae0682', '749bd738-2ac6-4b7d-b513-5ab02713c90f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:52 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Delete snapshot completed successfully. Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-4114fad1-10d2-4bfa-be16-f7fac9b8b3be tempest-CinderUnicodeTest-185972375 None] Lock "cinder-2239615e-8425-48c5-ba78-9b171eb574d6-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-9dc92772-f233-455f-a3f3-6b2c7604afc5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Lock "cinder-9dc92772-f233-455f-a3f3-6b2c7604afc5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-quobyte-9dc92772-f233-455f-a3f3-6b2c7604afc5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-9dc92772-f233-455f-a3f3-6b2c7604afc5" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dbecb9-8c56-4460-8e00-375eb434ab6a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:52 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 Apr 10 16:23:52 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:52 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:52 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5 Apr 10 16:23:52 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:53 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9dc92772-f233-455f-a3f3-6b2c7604afc5" returned: 0 in 0.409s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-9dc92772-f233-455f-a3f3-6b2c7604afc5" released by "delete_volume" :: held 0.940s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Created reservations ['5b414c31-f73f-4798-af6b-55630cda3a90', '2ba474b0-8e9f-4299-8204-8b70d63b86e5', 'b3da10ec-ba06-4e2b-90e0-4e8a585c4c1a', 'b72e328b-ff9c-4e35-81ea-b3caaace792f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:53 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:53 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-bc0ca5cb-1e26-457d-9f0d-d944c19f533e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Lock "cinder-bc0ca5cb-1e26-457d-9f0d-d944c19f533e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Acquiring lock "cinder-quobyte-bc0ca5cb-1e26-457d-9f0d-d944c19f533e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-bc0ca5cb-1e26-457d-9f0d-d944c19f533e" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3908dfa-851d-4452-bd55-7ac786c14e67]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:53 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e Apr 10 16:23:53 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:53 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.426s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Deleted volume successfully. Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-6feaffc2-1145-45d6-af97-a6577514eb2b tempest-CinderUnicodeTest-185972375 None] Lock "cinder-9dc92772-f233-455f-a3f3-6b2c7604afc5-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:53 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e" returned: 0 in 0.479s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:53 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e Apr 10 16:23:53 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:54 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-bc0ca5cb-1e26-457d-9f0d-d944c19f533e" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Lock "cinder-quobyte-bc0ca5cb-1e26-457d-9f0d-d944c19f533e" released by "delete_volume" :: held 0.912s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=111,cinder:INSERT=29,cinder:UPDATE=113,cinder:DELETE=12 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Created reservations ['c4ab3c49-3944-44c1-8a34-ea5b391171ba', '1b69917e-d444-4a84-aa33-634a1ef5e25b', '1f68d168-821e-429b-94b7-7e5636279947', 'b9437c4b-30da-46b7-aaf3-abb94320ff69'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:23:54 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:23:54 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:23:54 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.512s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:23:54 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:23:55 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Deleted volume successfully. Apr 10 16:23:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0d0a2b27-ebfd-49b9-9468-e26a868d64a5 tempest-CinderUnicodeTest-185972375 None] Lock "cinder-bc0ca5cb-1e26-457d-9f0d-d944c19f533e-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=93,cinder:INSERT=32,cinder:UPDATE=118,cinder:DELETE=6 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (c4bc6680-fede-4822-83d2-2382989d08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34146ad5-54db-4cbf-971e-390ebffae5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34146ad5-54db-4cbf-971e-390ebffae5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722689148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618e5a43-d790-4d22-bd86-1b73ef283eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcc5fdc-5d11-4e3e-abff-13da4fb86563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcc5fdc-5d11-4e3e-abff-13da4fb86563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb100cd-af91-454e-b554-19e4eaa8c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb100cd-af91-454e-b554-19e4eaa8c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618e5a43-d790-4d22-bd86-1b73ef283eb6', 'volume_name': 'volume-618e5a43-d790-4d22-bd86-1b73ef283eb6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25461fb7-2510-415d-9495-a15b0c59e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25461fb7-2510-415d-9495-a15b0c59e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2c9260-7997-4d67-beda-9b1e58e02efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume 618e5a43-d790-4d22-bd86-1b73ef283eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618e5a43-d790-4d22-bd86-1b73ef283eb6', 'volume_size': 1} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722689148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618e5a43-d790-4d22-bd86-1b73ef283eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating volume 618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:01 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:01 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 1073741824 Apr 10 16:24:01 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (a4420148-b972-4407-afe1-266862afd10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c5d296-c75b-40a6-8fa9-f19345554c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c5d296-c75b-40a6-8fa9-f19345554c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-492110888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e6a177-a081-4475-a7d6-9f0d7a485359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41697857a0f4d74a68bf9be597acb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='59f9bd8e56094f5c95431ff2a6afa7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65c6d1f-ce5b-467b-b4b6-aa54ddb26b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65c6d1f-ce5b-467b-b4b6-aa54ddb26b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e621fee2-bbda-4ee7-adb7-59785fee7188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e621fee2-bbda-4ee7-adb7-59785fee7188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e6a177-a081-4475-a7d6-9f0d7a485359', 'volume_name': 'volume-82e6a177-a081-4475-a7d6-9f0d7a485359', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c25b3b-6de4-4c82-8219-adb0cf83e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c25b3b-6de4-4c82-8219-adb0cf83e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790e561e-5299-48f5-981a-00a00deb04c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Volume 82e6a177-a081-4475-a7d6-9f0d7a485359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e6a177-a081-4475-a7d6-9f0d7a485359', 'volume_size': 1} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (cbd7f40c-4d14-44f5-af32-948533bc4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4197f9-f339-4b4c-a97e-fa5fdb949c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4197f9-f339-4b4c-a97e-fa5fdb949c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686092656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9ec757-ac7a-41f7-ad86-4004acd2b446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91908906-5652-4a96-a9fe-d58d7168b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91908906-5652-4a96-a9fe-d58d7168b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1245db73-e380-47c0-a11a-30fb6b585876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1245db73-e380-47c0-a11a-30fb6b585876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9ec757-ac7a-41f7-ad86-4004acd2b446', 'volume_name': 'volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2595b145-628d-49fb-8b7c-6f8e6f5cde1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2595b145-628d-49fb-8b7c-6f8e6f5cde1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3606d9-309c-4050-89d9-40d8921b9156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:01 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Volume 0c9ec757-ac7a-41f7-ad86-4004acd2b446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446', 'volume_size': 1} Apr 10 16:24:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (201f9dc6-efbb-45c3-88df-cae2ad43049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753f6296-c15f-4d63-bf5a-23b85bdbde52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753f6296-c15f-4d63-bf5a-23b85bdbde52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-393747910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6530bdb3-2ae0-4c7d-b503-1bb86a1e2468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4cc5a7-2622-4604-bd3c-66165da8334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4cc5a7-2622-4604-bd3c-66165da8334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b8e2b6-d582-4ffb-9e29-0dddc77d2f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b8e2b6-d582-4ffb-9e29-0dddc77d2f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6530bdb3-2ae0-4c7d-b503-1bb86a1e2468', 'volume_name': 'volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e514ef5-2555-471d-8f87-f5fbaabe4a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e514ef5-2555-471d-8f87-f5fbaabe4a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b14240-9a16-46cf-a338-2f781bb9bbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Volume 6530bdb3-2ae0-4c7d-b503-1bb86a1e2468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468', 'volume_size': 1} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (690ad951-6ab6-4e4b-a93b-d19ecafa8f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e177877-8711-4439-bac5-2d903b5ab610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e177877-8711-4439-bac5-2d903b5ab610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343722544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69e68f3-c429-468a-a559-531ea4a15d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649fe5ea-cc9f-4618-bb4d-e2f40b096b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649fe5ea-cc9f-4618-bb4d-e2f40b096b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54a5efa-f33d-44b0-8a12-d453b15a28fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54a5efa-f33d-44b0-8a12-d453b15a28fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69e68f3-c429-468a-a559-531ea4a15d3a', 'volume_name': 'volume-e69e68f3-c429-468a-a559-531ea4a15d3a', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc37a99-72ac-4db9-9d67-2c67def27cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc37a99-72ac-4db9-9d67-2c67def27cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce76884-c2cf-4abb-ba2d-51f9b1bfd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Volume e69e68f3-c429-468a-a559-531ea4a15d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69e68f3-c429-468a-a559-531ea4a15d3a', 'volume_size': 1} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 1073741824" returned: 0 in 0.730s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:02 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 Apr 10 16:24:02 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (9bf33f9b-3ea7-486b-9c27-e7f33b21be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495a3670-8b2c-4cf6-abcd-85facf1668ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495a3670-8b2c-4cf6-abcd-85facf1668ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-483250539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6f90e4-121e-4629-aede-225dd78e1ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:03Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df65855-e774-4940-a337-a60c41580bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df65855-e774-4940-a337-a60c41580bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203be1f3-3254-4ec6-80ba-70647c2f6905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203be1f3-3254-4ec6-80ba-70647c2f6905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6f90e4-121e-4629-aede-225dd78e1ba7', 'volume_name': 'volume-6c6f90e4-121e-4629-aede-225dd78e1ba7', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6fd622-2860-4271-8dd5-9a0e88a00c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6fd622-2860-4271-8dd5-9a0e88a00c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfeb646-77ff-4e9f-b8e2-0f6faabc8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Volume 6c6f90e4-121e-4629-aede-225dd78e1ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6f90e4-121e-4629-aede-225dd78e1ba7', 'volume_size': 1} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (a0be9149-54cf-4c41-a17e-6d0293174d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7d8147-c532-4b2f-8d9a-b7840b2fab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7d8147-c532-4b2f-8d9a-b7840b2fab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-362178270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1063b558-3ad6-48df-9ab7-20ec45513e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:03Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f72ec3-f278-46ab-96b0-798d4ba54c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f72ec3-f278-46ab-96b0-798d4ba54c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf32e4e-0469-47cb-9922-1a3d1db654cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf32e4e-0469-47cb-9922-1a3d1db654cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1063b558-3ad6-48df-9ab7-20ec45513e99', 'volume_name': 'volume-1063b558-3ad6-48df-9ab7-20ec45513e99', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de649da-d3b0-46da-b0db-7e4414aa0ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de649da-d3b0-46da-b0db-7e4414aa0ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e0b12b-973a-44ee-a1d6-d49dc8a6e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:02 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Volume 1063b558-3ad6-48df-9ab7-20ec45513e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1063b558-3ad6-48df-9ab7-20ec45513e99', 'volume_size': 1} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:02 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6" returned: 0 in 0.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-492110888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e6a177-a081-4475-a7d6-9f0d7a485359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41697857a0f4d74a68bf9be597acb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='59f9bd8e56094f5c95431ff2a6afa7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Creating volume 82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:02 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2c9260-7997-4d67-beda-9b1e58e02efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618e5a43-d790-4d22-bd86-1b73ef283eb6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:02 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 1073741824 Apr 10 16:24:02 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:02 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def03aaa-dc7d-4ae1-8c27-23a8cd8a715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:03 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 (618e5a43-d790-4d22-bd86-1b73ef283eb6): created successfully Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def03aaa-dc7d-4ae1-8c27-23a8cd8a715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (c4bc6680-fede-4822-83d2-2382989d08fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:03 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f0280b4f-5b47-4365-bf9b-07f680c6e3c6 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created volume successfully. Apr 10 16:24:03 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 1073741824" returned: 0 in 0.504s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:03 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:03 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:03 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.011s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686092656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9ec757-ac7a-41f7-ad86-4004acd2b446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Creating volume 0c9ec757-ac7a-41f7-ad86-4004acd2b446 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:03 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:03 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 1073741824 Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790e561e-5299-48f5-981a-00a00deb04c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e6a177-a081-4475-a7d6-9f0d7a485359', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:03 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:03 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a59cf08-4830-4089-8032-c41f692c8570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:04 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Volume volume-82e6a177-a081-4475-a7d6-9f0d7a485359 (82e6a177-a081-4475-a7d6-9f0d7a485359): created successfully Apr 10 16:24:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a59cf08-4830-4089-8032-c41f692c8570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:04 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (a4420148-b972-4407-afe1-266862afd10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:04 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-14d1221d-2deb-4187-9a91-18de4caaa221 tempest-VolumeDependencyTests-1972611021 None] Created volume successfully. Apr 10 16:24:04 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 1073741824" returned: 0 in 0.490s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:04 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 Apr 10 16:24:04 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:04 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:05 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446" returned: 0 in 0.530s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.810s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-393747910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6530bdb3-2ae0-4c7d-b503-1bb86a1e2468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Creating volume 6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:05 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3606d9-309c-4050-89d9-40d8921b9156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:05 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 1073741824 Apr 10 16:24:05 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc6088c-426e-46ac-994b-58a9eeedf0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:05 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Volume volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 (0c9ec757-ac7a-41f7-ad86-4004acd2b446): created successfully Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc6088c-426e-46ac-994b-58a9eeedf0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (cbd7f40c-4d14-44f5-af32-948533bc4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:05 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1973c121-5eba-42a2-88eb-ab3ba9e92c63 tempest-CreateVolumesFromImageTest-1173690409 None] Created volume successfully. Apr 10 16:24:05 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 1073741824" returned: 0 in 0.508s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:05 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 Apr 10 16:24:05 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:05 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.519s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343722544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69e68f3-c429-468a-a559-531ea4a15d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:02Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Creating volume e69e68f3-c429-468a-a559-531ea4a15d3a {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:05 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:05 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b14240-9a16-46cf-a338-2f781bb9bbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:06 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a 1073741824 Apr 10 16:24:06 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9e9d7c-5aba-47f8-a8d9-5f4636c292f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:06 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Volume volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 (6530bdb3-2ae0-4c7d-b503-1bb86a1e2468): created successfully Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9e9d7c-5aba-47f8-a8d9-5f4636c292f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (201f9dc6-efbb-45c3-88df-cae2ad43049a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-aa61af16-afd5-4f72-8a78-f379be8f3094 tempest-CreateVolumesFromImageTest-1173690409 None] Created volume successfully. Apr 10 16:24:06 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a 1073741824" returned: 0 in 0.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:06 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a Apr 10 16:24:06 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:06 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a" returned: 0 in 0.417s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.162s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-483250539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6f90e4-121e-4629-aede-225dd78e1ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:03Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Creating volume 6c6f90e4-121e-4629-aede-225dd78e1ba7 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:06 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce76884-c2cf-4abb-ba2d-51f9b1bfd456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69e68f3-c429-468a-a559-531ea4a15d3a', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78559dee-2859-4869-92e3-c5e95c595d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:06 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 1073741824 Apr 10 16:24:06 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:06 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Volume volume-e69e68f3-c429-468a-a559-531ea4a15d3a (e69e68f3-c429-468a-a559-531ea4a15d3a): created successfully Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78559dee-2859-4869-92e3-c5e95c595d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:06 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (690ad951-6ab6-4e4b-a93b-d19ecafa8f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:06 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d6f3b16b-d629-4584-ac7e-7700a78ec456 tempest-CreateVolumesFromImageTest-1173690409 None] Created volume successfully. Apr 10 16:24:07 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 1073741824" returned: 0 in 0.580s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:07 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 Apr 10 16:24:07 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:07 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7" returned: 0 in 0.418s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.109s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-362178270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1063b558-3ad6-48df-9ab7-20ec45513e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e28cf4ddf64434a8dc91d118b486bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:03Z,use_quota=True,user_id='f201104a0b514c379255ad4ca4ae49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Creating volume 1063b558-3ad6-48df-9ab7-20ec45513e99 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:07 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfeb646-77ff-4e9f-b8e2-0f6faabc8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6f90e4-121e-4629-aede-225dd78e1ba7', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:07 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fff9dfc-275f-4138-9e72-e1a47ef1f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:07 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 1073741824 Apr 10 16:24:07 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:07 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Volume volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 (6c6f90e4-121e-4629-aede-225dd78e1ba7): created successfully Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fff9dfc-275f-4138-9e72-e1a47ef1f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (9bf33f9b-3ea7-486b-9c27-e7f33b21be8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:08 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e7786564-1c75-4091-89ea-e1bf2159d081 tempest-CreateVolumesFromImageTest-1173690409 None] Created volume successfully. Apr 10 16:24:08 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 1073741824" returned: 0 in 0.523s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:08 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 Apr 10 16:24:08 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:08 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99" returned: 0 in 0.413s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.036s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e0b12b-973a-44ee-a1d6-d49dc8a6e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1063b558-3ad6-48df-9ab7-20ec45513e99', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec1edf0-928f-4a85-b8b0-89b68548dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating offline snapshot 992a49f3-d8cf-48a2-810f-5c39878e13e5 of volume 618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:24:08 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Volume volume-1063b558-3ad6-48df-9ab7-20ec45513e99 (1063b558-3ad6-48df-9ab7-20ec45513e99): created successfully Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec1edf0-928f-4a85-b8b0-89b68548dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Flow 'volume_create_manager' (a0be9149-54cf-4c41-a17e-6d0293174d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6784df71-5689-4712-9d90-9d13d2be240c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:08 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:08 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-914f05a7-858f-4b20-866a-34d9299238ea tempest-CreateVolumesFromImageTest-1173690409 None] Created volume successfully. Apr 10 16:24:09 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 Apr 10 16:24:09 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-1063b558-3ad6-48df-9ab7-20ec45513e99-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-1063b558-3ad6-48df-9ab7-20ec45513e99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-quobyte-1063b558-3ad6-48df-9ab7-20ec45513e99" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-1063b558-3ad6-48df-9ab7-20ec45513e99" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb564783-8523-4c7d-879f-c8f39358532c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:09 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 Apr 10 16:24:09 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:09 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6" returned: 0 in 0.534s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:09 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 1G Apr 10 16:24:09 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:09 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99" returned: 0 in 0.534s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:09 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:09 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99 Apr 10 16:24:09 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:10 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 1G" returned: 0 in 0.580s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:10 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 Apr 10 16:24:10 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:10 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-1063b558-3ad6-48df-9ab7-20ec45513e99" returned: 0 in 0.515s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-1063b558-3ad6-48df-9ab7-20ec45513e99" released by "delete_volume" :: held 1.074s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Created reservations ['ce3d111a-6799-433c-9dc6-de0d17184bfe', '105a9ec6-48d5-42d1-8f4d-be1d1cb66910', 'dfd05fdd-b2f2-4440-a9c1-541fd4c9a8b8', 'a8962bd9-491f-43ab-baea-222dc0e02373'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:10 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:10 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:10 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5" returned: 0 in 0.514s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:10 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 is being set with open permissions: ugo+rw Apr 10 16:24:10 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:10 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 Apr 10 16:24:10 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:11 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.467s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:11 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Deleted volume successfully. Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-1f594e29-fb13-4798-aa6c-e135483d17c3 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-1063b558-3ad6-48df-9ab7-20ec45513e99-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:11 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5" returned: 0 in 0.480s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:11 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info Apr 10 16:24:11 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-6c6f90e4-121e-4629-aede-225dd78e1ba7-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-6c6f90e4-121e-4629-aede-225dd78e1ba7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-quobyte-6c6f90e4-121e-4629-aede-225dd78e1ba7" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-6c6f90e4-121e-4629-aede-225dd78e1ba7" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9fba93-eeed-4360-9d8b-52396d3e215c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:11 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info" returned: 0 in 0.477s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:11 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info is being set with open permissions: ugo+rw Apr 10 16:24:11 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:11 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info Apr 10 16:24:11 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:11 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 Apr 10 16:24:11 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:12 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.info" returned: 0 in 0.461s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.144s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Creating offline snapshot f447371f-01a4-4eb1-9a2c-e16ab2da0862 of volume 82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c20ba-00ae-49b3-ab03-ff3979bab3d9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:12 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-6012705d-6afa-4b92-b1d0-da63278760df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Create snapshot completed successfully Apr 10 16:24:12 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7" returned: 0 in 0.642s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:12 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:12 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:12 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7 Apr 10 16:24:12 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:12 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6c6f90e4-121e-4629-aede-225dd78e1ba7" returned: 0 in 0.535s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:12 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.633s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-6c6f90e4-121e-4629-aede-225dd78e1ba7" released by "delete_volume" :: held 1.212s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:12 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 1G Apr 10 16:24:12 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Created reservations ['94a56d8c-a559-42b9-9b1f-e67faa0c8060', '45d717e1-7804-4d13-9440-a70b28c63314', 'aca13e91-23b1-4953-b3d7-fbc60afa58ed', '68741038-6209-40d6-8d27-d50da6e9ea35'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:12 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:12 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:12 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:13 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.587s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:13 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Deleted volume successfully. Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8994c36b-acbd-47b1-a69a-b6caef6ac48b tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-6c6f90e4-121e-4629-aede-225dd78e1ba7-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:13 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 1G" returned: 0 in 0.766s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e6a177-a081-4475-a7d6-9f0d7a485359 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:13 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e6a177-a081-4475-a7d6-9f0d7a485359 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 Apr 10 16:24:13 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (2178c48e-c7ee-4f26-a5be-095ee8e7edc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f165ba-e417-4e6b-a876-9f2a7bf4fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f165ba-e417-4e6b-a876-9f2a7bf4fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094586677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf2a50f-80b6-47d4-babf-f7dc01283d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:14Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b13915-43ba-4453-8a73-1e83d6baa0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b13915-43ba-4453-8a73-1e83d6baa0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25387570-5872-451a-a502-527d1299d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25387570-5872-451a-a502-527d1299d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf2a50f-80b6-47d4-babf-f7dc01283d9b', 'volume_name': 'volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5984776-85bd-4a05-9c7b-2901802a97d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5984776-85bd-4a05-9c7b-2901802a97d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062eb426-75d7-4a00-9201-649ecf92f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:13 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume 6cf2a50f-80b6-47d4-babf-f7dc01283d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b', 'volume_size': 1} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-e69e68f3-c429-468a-a559-531ea4a15d3a-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-e69e68f3-c429-468a-a559-531ea4a15d3a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-quobyte-e69e68f3-c429-468a-a559-531ea4a15d3a" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-e69e68f3-c429-468a-a559-531ea4a15d3a" acquired by "delete_volume" :: waited 0.033s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9d700-2271-4624-9d95-d59a0a9e5a72]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:13 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:14 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a Apr 10 16:24:14 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (1c85f41b-d210-45c6-a500-d56f6b50387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780b6d3-37cb-47b4-81b8-39a8e88d8dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780b6d3-37cb-47b4-81b8-39a8e88d8dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319799529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc396d8-aa0c-4c76-89fc-eb49ff4cf028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:14Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a19b9c7-9722-4402-b7cb-27d4e521f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a19b9c7-9722-4402-b7cb-27d4e521f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc20ddc-2a3c-494e-b4bb-891eecbb21b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc20ddc-2a3c-494e-b4bb-891eecbb21b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc396d8-aa0c-4c76-89fc-eb49ff4cf028', 'volume_name': 'volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa14860-d735-4c6f-aee2-06f19e1655c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa14860-d735-4c6f-aee2-06f19e1655c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c31d6be-e44c-4585-a885-9f33d5b0d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume 4bc396d8-aa0c-4c76-89fc-eb49ff4cf028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028', 'volume_size': 1} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (71698441-44db-40d5-968f-adb3863c90d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07b2b55-c83b-41a3-b07b-e43f5e750611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07b2b55-c83b-41a3-b07b-e43f5e750611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609052184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74d55e1-75c5-432a-86f1-90512635b0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:14Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7992c2-73c2-4f39-9656-a2c7aa76abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7992c2-73c2-4f39-9656-a2c7aa76abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f5b27c-493f-4df0-b222-715daa32026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f5b27c-493f-4df0-b222-715daa32026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74d55e1-75c5-432a-86f1-90512635b0e6', 'volume_name': 'volume-e74d55e1-75c5-432a-86f1-90512635b0e6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677723d4-da51-4329-a964-ca8b55905c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677723d4-da51-4329-a964-ca8b55905c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19b3c7c-9c32-49bc-9c2d-a97438d87a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume e74d55e1-75c5-432a-86f1-90512635b0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74d55e1-75c5-432a-86f1-90512635b0e6', 'volume_size': 1} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e6a177-a081-4475-a7d6-9f0d7a485359 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862" returned: 0 in 0.877s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:14 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 is being set with open permissions: ugo+rw Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:14 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 Apr 10 16:24:14 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:14 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (5cb02f87-a81b-4521-b5b0-7a4032bf9a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa19dd4e-7d64-412a-b44b-96995778f719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a" returned: 0 in 0.827s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa19dd4e-7d64-412a-b44b-96995778f719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-25089441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4aab27-49ad-433a-83b5-3c87db95bb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:15Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a Apr 10 16:24:14 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad65066-ce9b-44d2-bfd8-0aeb3f975bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad65066-ce9b-44d2-bfd8-0aeb3f975bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b02afbe-56a0-4113-9066-d06bbc6ebc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b02afbe-56a0-4113-9066-d06bbc6ebc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4aab27-49ad-433a-83b5-3c87db95bb7d', 'volume_name': 'volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fc2a1f-fc02-4ea4-b8ff-040c8b38d469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fc2a1f-fc02-4ea4-b8ff-040c8b38d469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b423bb-9eb9-418a-ae7a-7416d69872c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:14 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume 6e4aab27-49ad-433a-83b5-3c87db95bb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d', 'volume_size': 1} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:14 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (64ba1a1b-a8cc-446b-9543-b4cad0db200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d27d7c-1516-4627-9095-908d92dc8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d27d7c-1516-4627-9095-908d92dc8a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129756082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71ebedf-917f-42cd-8f10-ef40ce24cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:15Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7095262-e2cf-452b-bb4b-861bb253e2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7095262-e2cf-452b-bb4b-861bb253e2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04085d60-21ee-4a87-aaad-caa909ecf437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04085d60-21ee-4a87-aaad-caa909ecf437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71ebedf-917f-42cd-8f10-ef40ce24cdcf', 'volume_name': 'volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a7874a-ff41-4524-89d3-2ffaa3c28c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a7874a-ff41-4524-89d3-2ffaa3c28c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c2558-f92f-4fc6-9477-264726a2e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:15 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume f71ebedf-917f-42cd-8f10-ef40ce24cdcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf', 'volume_size': 1} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:15 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862" returned: 0 in 0.660s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:15 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info Apr 10 16:24:15 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:15 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e69e68f3-c429-468a-a559-531ea4a15d3a" returned: 0 in 0.577s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-e69e68f3-c429-468a-a559-531ea4a15d3a" released by "delete_volume" :: held 1.444s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_service.periodic_task [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82117) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:15 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:15 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Created reservations ['daa6baa5-ab44-4bda-95fc-9e86c19f710c', 'fcd89947-2234-447f-9358-b1ae434bb9c3', 'dd5b1244-95df-44e0-b687-b75d381973b8', 'c50cc6e8-bac0-45de-8652-bedf2c43d036'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:15 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:15 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:15 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info" returned: 0 in 0.541s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:15 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info is being set with open permissions: ugo+rw Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:15 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info Apr 10 16:24:15 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:15 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.579s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:15 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0151c799-c746-41e8-9c02-46dc2258d68a None None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-quobyte-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28cbcf2-131b-4fce-9c4e-bd29f6ef8af7]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:16 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.625s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:16 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Deleted volume successfully. Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f225a220-5a9c-4a0a-bcd6-bf58840716de tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-e69e68f3-c429-468a-a559-531ea4a15d3a-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:16 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.info" returned: 0 in 0.621s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.198s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.476s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094586677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf2a50f-80b6-47d4-babf-f7dc01283d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:14Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating volume 6cf2a50f-80b6-47d4-babf-f7dc01283d9b {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:16 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:16 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 Apr 10 16:24:16 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:16 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b 1073741824 Apr 10 16:24:16 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:16 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-63d6af67-b488-4584-a6f0-3c5ef93d1770 tempest-VolumeDependencyTests-1972611021 None] Create snapshot completed successfully Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Flow 'volume_create_manager' (e816c9dd-2bac-477e-9ba0-7baa174a1d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3227e7f-045a-41be-99f2-22063156cb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3227e7f-045a-41be-99f2-22063156cb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-369479522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37cdee5-f63f-4ce5-a87a-3bebdd140eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16b81e73100408ebe983d15335ea239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:16Z,use_quota=True,user_id='a700836e9b114d288305e5e33ef27819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cd60df-0d7f-4e75-abaf-7b01db778406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cd60df-0d7f-4e75-abaf-7b01db778406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee486620-7c68-49c6-a795-9a09381b573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee486620-7c68-49c6-a795-9a09381b573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37cdee5-f63f-4ce5-a87a-3bebdd140eb3', 'volume_name': 'volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43af001b-5da8-45cd-ba7a-d5188307fa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43af001b-5da8-45cd-ba7a-d5188307fa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fea1c34-dbf1-418b-8fe2-21d1ced6687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:16 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Volume a37cdee5-f63f-4ce5-a87a-3bebdd140eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3', 'volume_size': 1} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:16 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468" returned: 0 in 0.610s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:16 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468 Apr 10 16:24:16 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:16 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b 1073741824" returned: 0 in 0.597s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:16 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:16 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b Apr 10 16:24:16 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:17 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468" returned: 0 in 0.432s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468" released by "delete_volume" :: held 1.070s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Created reservations ['82637001-e30b-4f4a-bf59-496958d6406f', '9373d868-114a-4c1e-9c3e-82120c934428', '416da2d7-09ee-44c1-91ed-e8ff31db2964', '6c46826d-93be-4b86-af5c-c480b1c85c55'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:17 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:17 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:17 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b" returned: 0 in 0.441s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.199s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319799529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc396d8-aa0c-4c76-89fc-eb49ff4cf028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:14Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating volume 4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:17 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062eb426-75d7-4a00-9201-649ecf92f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9350d9e7-e402-4b8a-87c7-d48b5949d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:17 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 1073741824 Apr 10 16:24:17 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b (6cf2a50f-80b6-47d4-babf-f7dc01283d9b): created successfully Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9350d9e7-e402-4b8a-87c7-d48b5949d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (2178c48e-c7ee-4f26-a5be-095ee8e7edc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:17 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-57a19354-5ed9-4335-8b5f-09c2e431a971 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created volume successfully. Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (89a55a79-6110-451c-92e1-816415a53fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105817b4-232c-4fef-aba8-ed381858a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105817b4-232c-4fef-aba8-ed381858a06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1007889843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68875414-68ef-43fe-a438-d8a363326f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41697857a0f4d74a68bf9be597acb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f447371f-01a4-4eb1-9a2c-e16ab2da0862,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:18Z,use_quota=True,user_id='59f9bd8e56094f5c95431ff2a6afa7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aa877c-ee08-4998-a17b-f743e9298964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aa877c-ee08-4998-a17b-f743e9298964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43214c77-62bf-4070-a09a-e51a35c6ee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43214c77-62bf-4070-a09a-e51a35c6ee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68875414-68ef-43fe-a438-d8a363326f5a', 'volume_name': 'volume-68875414-68ef-43fe-a438-d8a363326f5a', 'volume_size': 1, 'snapshot_id': 'f447371f-01a4-4eb1-9a2c-e16ab2da0862'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ec114c-0fc4-4bf2-8b9c-21a929b1f55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ec114c-0fc4-4bf2-8b9c-21a929b1f55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faabcf97-0d60-470c-a2ae-d217f68f6d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:17 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Volume 68875414-68ef-43fe-a438-d8a363326f5a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68875414-68ef-43fe-a438-d8a363326f5a', 'volume_size': 1, 'snapshot_id': 'f447371f-01a4-4eb1-9a2c-e16ab2da0862'} Apr 10 16:24:17 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:17 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Deleted volume successfully. Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-46eb8bcc-da1e-46ff-bae9-19c24657d0e6 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-6530bdb3-2ae0-4c7d-b503-1bb86a1e2468-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:17 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 1073741824" returned: 0 in 0.494s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:17 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:17 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 Apr 10 16:24:17 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-0c9ec757-ac7a-41f7-ad86-4004acd2b446-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-0c9ec757-ac7a-41f7-ad86-4004acd2b446-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "cinder-quobyte-0c9ec757-ac7a-41f7-ad86-4004acd2b446" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-0c9ec757-ac7a-41f7-ad86-4004acd2b446" acquired by "delete_volume" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b50dfa-3ac5-4700-8ae2-fde170d93cfb]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:18 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028" returned: 0 in 0.447s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.926s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609052184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74d55e1-75c5-432a-86f1-90512635b0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:14Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating volume e74d55e1-75c5-432a-86f1-90512635b0e6 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:18 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:18 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 1073741824 Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c31d6be-e44c-4585-a885-9f33d5b0d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:18 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3adad76-5fd9-4989-bac8-d0a970e397f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:18 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 (4bc396d8-aa0c-4c76-89fc-eb49ff4cf028): created successfully Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3adad76-5fd9-4989-bac8-d0a970e397f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:18 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 Apr 10 16:24:18 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (1c85f41b-d210-45c6-a500-d56f6b50387a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:18 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-df5c6ec1-0f3b-4d8d-bdf2-1d1d5461a660 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created volume successfully. Apr 10 16:24:18 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446" returned: 0 in 0.509s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:18 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446 Apr 10 16:24:18 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:18 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 1073741824" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:18 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:18 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 Apr 10 16:24:18 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:19 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-0c9ec757-ac7a-41f7-ad86-4004acd2b446" returned: 0 in 0.411s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-quobyte-0c9ec757-ac7a-41f7-ad86-4004acd2b446" released by "delete_volume" :: held 0.952s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Created reservations ['cbd8ec81-6e42-4227-8494-3720b76e33c9', 'dc08687a-1392-43d6-b82d-0e5bf4366c03', 'f175c1eb-8fb1-45fd-a387-edba6b15d90d', '4b7ad96f-50fa-4f09-873e-4d143297f2b2'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:19 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:19 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:19 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.518s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-25089441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4aab27-49ad-433a-83b5-3c87db95bb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:15Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating volume 6e4aab27-49ad-433a-83b5-3c87db95bb7d {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:19 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19b3c7c-9c32-49bc-9c2d-a97438d87a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74d55e1-75c5-432a-86f1-90512635b0e6', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:19 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d 1073741824 Apr 10 16:24:19 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bf3150-3725-4af8-aa60-b36bf89c67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:19 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume volume-e74d55e1-75c5-432a-86f1-90512635b0e6 (e74d55e1-75c5-432a-86f1-90512635b0e6): created successfully Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bf3150-3725-4af8-aa60-b36bf89c67b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (71698441-44db-40d5-968f-adb3863c90d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-4376d6c7-380f-4f7e-9442-95dac0f801f1 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created volume successfully. Apr 10 16:24:19 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.541s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:19 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Deleted volume successfully. Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-28a6a245-103e-4bdd-a00f-a411cc7c0500 tempest-CreateVolumesFromImageTest-1173690409 None] Lock "cinder-0c9ec757-ac7a-41f7-ad86-4004acd2b446-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:19 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d 1073741824" returned: 0 in 0.565s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:19 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:19 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d Apr 10 16:24:19 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:20 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.354s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129756082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71ebedf-917f-42cd-8f10-ef40ce24cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841848bfd0f145a5b2b32abf199f2e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:15Z,use_quota=True,user_id='d772a4b223e54c61a8ec38b9470101d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Creating volume f71ebedf-917f-42cd-8f10-ef40ce24cdcf {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:20 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b423bb-9eb9-418a-ae7a-7416d69872c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:20 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf 1073741824 Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85edbd0-8b61-4620-b637-cb849ed0f10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:20 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:20 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d (6e4aab27-49ad-433a-83b5-3c87db95bb7d): created successfully Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85edbd0-8b61-4620-b637-cb849ed0f10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (5cb02f87-a81b-4521-b5b0-7a4032bf9a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:20 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d25da340-b914-46ac-9aeb-3f0212c0f5ea tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created volume successfully. Apr 10 16:24:20 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf 1073741824" returned: 0 in 0.559s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:20 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:21 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf Apr 10 16:24:21 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (410a36fa-ff7d-456f-8def-a2ac4aa61703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d09e2d2-eccf-4e8c-8d66-d2e06c2ec6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d09e2d2-eccf-4e8c-8d66-d2e06c2ec6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401783507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2aa6d5-445e-4f63-a75d-c1463d9ca733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:21Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ef0e5c-8752-4c48-9c76-f11b1e757ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ef0e5c-8752-4c48-9c76-f11b1e757ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903b5068-3c79-489c-9f10-ccb2b374fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903b5068-3c79-489c-9f10-ccb2b374fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2aa6d5-445e-4f63-a75d-c1463d9ca733', 'volume_name': 'volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6793286-ff23-4d14-930c-ce707ebc1d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6793286-ff23-4d14-930c-ce707ebc1d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373064d8-c896-4c08-9917-3fe91aec3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:21 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume be2aa6d5-445e-4f63-a75d-c1463d9ca733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733', 'volume_size': 1} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:21 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.906s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-369479522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37cdee5-f63f-4ce5-a87a-3bebdd140eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16b81e73100408ebe983d15335ea239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:16Z,use_quota=True,user_id='a700836e9b114d288305e5e33ef27819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Creating volume a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:21 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c2558-f92f-4fc6-9477-264726a2e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e49ee9-0875-475d-9d45-67cd327287e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:21 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 1073741824 Apr 10 16:24:21 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:21 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Volume volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf (f71ebedf-917f-42cd-8f10-ef40ce24cdcf): created successfully Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e49ee9-0875-475d-9d45-67cd327287e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Flow 'volume_create_manager' (64ba1a1b-a8cc-446b-9543-b4cad0db200f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:21 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-33ca9a76-8b7f-4b9b-9e2f-faae416b3691 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created volume successfully. Apr 10 16:24:21 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 1073741824" returned: 0 in 0.521s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:21 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:21 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:21 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:22 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.421s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.604s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-f447371f-01a4-4eb1-9a2c-e16ab2da0862-68875414-68ef-43fe-a438-d8a363326f5a" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fea1c34-dbf1-418b-8fe2-21d1ced6687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962c9cc7-df8b-431f-8e7c-0c9935a6c1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:22 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Volume volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 (a37cdee5-f63f-4ce5-a87a-3bebdd140eb3): created successfully Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962c9cc7-df8b-431f-8e7c-0c9935a6c1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Flow 'volume_create_manager' (e816c9dd-2bac-477e-9ba0-7baa174a1d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-f447371f-01a4-4eb1-9a2c-e16ab2da0862-68875414-68ef-43fe-a438-d8a363326f5a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Creating volume 68875414-68ef-43fe-a438-d8a363326f5a from snapshot f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-68875414-68ef-43fe-a438-d8a363326f5a" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-68875414-68ef-43fe-a438-d8a363326f5a" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] snapshot: f447371f-01a4-4eb1-9a2c-e16ab2da0862, volume: 68875414-68ef-43fe-a438-d8a363326f5a, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:24:22 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-091fac3b-c0eb-4235-9d33-7d418d67cd63 tempest-SnapshotDependencyTests-1602553829 None] Created volume successfully. Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054ad6e-4b41-445d-b5e7-385a5c70cb9f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:22 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 Apr 10 16:24:22 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-f71ebedf-917f-42cd-8f10-ef40ce24cdcf-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-f71ebedf-917f-42cd-8f10-ef40ce24cdcf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-f71ebedf-917f-42cd-8f10-ef40ce24cdcf" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-f71ebedf-917f-42cd-8f10-ef40ce24cdcf" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f271d57-f03e-4b1b-9700-0d0044d84c7a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:22 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf Apr 10 16:24:22 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:22 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:23 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862" returned: 0 in 0.527s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e6a177-a081-4475-a7d6-9f0d7a485359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f29d6-f26e-4c24-8822-d692f7a5e0ab]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:23 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:23 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:23 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:23 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf Apr 10 16:24:23 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:23 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.485s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:23 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a Apr 10 16:24:23 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:23 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-f71ebedf-917f-42cd-8f10-ef40ce24cdcf" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-f71ebedf-917f-42cd-8f10-ef40ce24cdcf" released by "delete_volume" :: held 0.954s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['7e257753-b960-4d7d-8274-43e42d22f729', 'e78110c2-f157-4f27-b9df-3f13d6c81777', '127440d7-31a6-4aba-9424-f5b468d99df3', 'b6b2bae9-c8e2-4f27-9fb5-eba26c721a13'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:23 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:23 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-6e4aab27-49ad-433a-83b5-3c87db95bb7d-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-6e4aab27-49ad-433a-83b5-3c87db95bb7d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-6e4aab27-49ad-433a-83b5-3c87db95bb7d" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-6e4aab27-49ad-433a-83b5-3c87db95bb7d" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8673e-6509-494e-abc1-9e5f156d29a0]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:23 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:23 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d Apr 10 16:24:23 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:24 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.662s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:24 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:24 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleted volume successfully. Apr 10 16:24:24 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a6b44399-65e4-4094-b503-47076103d8a4 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-f71ebedf-917f-42cd-8f10-ef40ce24cdcf-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:24 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d" returned: 0 in 0.961s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:24 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:24 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d Apr 10 16:24:24 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:25 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6e4aab27-49ad-433a-83b5-3c87db95bb7d" returned: 0 in 0.781s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-6e4aab27-49ad-433a-83b5-3c87db95bb7d" released by "delete_volume" :: held 1.767s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['9fc32999-920f-44e1-90c8-5406628ab03b', 'e5025834-38d6-449f-ae94-f3e521792ab4', 'd98a94cf-710e-4740-aa0f-fa568478d125', 'b912a4b0-f8f6-4356-9522-68e3c1626b83'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:25 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:25 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:25 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a" returned: 0 in 2.251s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9cdc51-c4cf-44d7-8821-3784a11a5ba4]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:25 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:25 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-e74d55e1-75c5-432a-86f1-90512635b0e6-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-e74d55e1-75c5-432a-86f1-90512635b0e6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-e74d55e1-75c5-432a-86f1-90512635b0e6" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-e74d55e1-75c5-432a-86f1-90512635b0e6" acquired by "delete_volume" :: waited 0.021s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[05662c43-b7e4-4f77-a7af-d3464e3a8af9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:25 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:26 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 Apr 10 16:24:26 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:26 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleted volume successfully. Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-ea8acd21-7a2d-481e-a8d7-7095d9d63ccd tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-6e4aab27-49ad-433a-83b5-3c87db95bb7d-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:26 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.615s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:24:26 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Converted 1024.00 MB image at 454.64 MB/s Apr 10 16:24:26 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a is being set with open permissions: ugo+rw Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:26 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a Apr 10 16:24:26 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:26 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:26 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6 Apr 10 16:24:26 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:26 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a" returned: 0 in 0.390s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-68875414-68ef-43fe-a438-d8a363326f5a" released by "_copy_volume_from_snapshot" :: held 4.333s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-f447371f-01a4-4eb1-9a2c-e16ab2da0862-68875414-68ef-43fe-a438-d8a363326f5a" released by "_create_volume_from_snapshot" :: held 4.351s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.387s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.578s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401783507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2aa6d5-445e-4f63-a75d-c1463d9ca733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:21Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Creating volume be2aa6d5-445e-4f63-a75d-c1463d9ca733 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:26 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:26 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 1073741824 Apr 10 16:24:26 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faabcf97-0d60-470c-a2ae-d217f68f6d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68875414-68ef-43fe-a438-d8a363326f5a', 'volume_size': 1, 'snapshot_id': 'f447371f-01a4-4eb1-9a2c-e16ab2da0862'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d821ecc-5ff8-44c4-b4b1-5f5a58fa638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:26 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Volume volume-68875414-68ef-43fe-a438-d8a363326f5a (68875414-68ef-43fe-a438-d8a363326f5a): created successfully Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d821ecc-5ff8-44c4-b4b1-5f5a58fa638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (89a55a79-6110-451c-92e1-816415a53fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:26 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-92e792e6-5d3c-418d-8a25-b79691186ba3 tempest-VolumeDependencyTests-1972611021 None] Created volume successfully. Apr 10 16:24:26 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-e74d55e1-75c5-432a-86f1-90512635b0e6" returned: 0 in 0.438s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-e74d55e1-75c5-432a-86f1-90512635b0e6" released by "delete_volume" :: held 0.969s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['00828024-3d5b-41d8-8e1b-8e785a139e9a', '7717b8a1-8ab4-4d1c-ad3b-327692b475c0', '811f53d9-8590-475b-99f5-092decb43e0d', 'cad23c99-aa5e-41b2-ba37-97c9ed42a3dd'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:26 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:27 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:27 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-f447371f-01a4-4eb1-9a2c-e16ab2da0862-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-f447371f-01a4-4eb1-9a2c-e16ab2da0862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-82e6a177-a081-4475-a7d6-9f0d7a485359" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-82e6a177-a081-4475-a7d6-9f0d7a485359" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-f447371f-01a4-4eb1-9a2c-e16ab2da0862" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-f447371f-01a4-4eb1-9a2c-e16ab2da0862" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Deleting offline snapshot f447371f-01a4-4eb1-9a2c-e16ab2da0862 of volume 82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] snapshot_file for this snap is: volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1520a993-e869-4f93-bc3c-d874558d5ecc]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:27 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 1073741824" returned: 0 in 0.541s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:27 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 Apr 10 16:24:27 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:27 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 Apr 10 16:24:27 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:27 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:27 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleted volume successfully. Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-9e562339-97be-4f86-87a6-eba2f0c302df tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-e74d55e1-75c5-432a-86f1-90512635b0e6-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:27 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733" returned: 0 in 0.403s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.876s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373064d8-c896-4c08-9917-3fe91aec3a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:27 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e2a1ce-e7b7-4b3f-9987-6fcbdf9dfed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Creating offline snapshot 9c8deb00-47de-4424-9fc1-2fcb86d60b06 of volume a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862" returned: 0 in 0.486s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e6a177-a081-4475-a7d6-9f0d7a485359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c99aaec-47a8-477c-b2fd-8615a432fd3b]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b95a55-98f3-4b16-b376-f8a75e9b3862]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:27 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 (be2aa6d5-445e-4f63-a75d-c1463d9ca733): created successfully Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e2a1ce-e7b7-4b3f-9987-6fcbdf9dfed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (410a36fa-ff7d-456f-8def-a2ac4aa61703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:27 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:27 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-74d896fe-c0d0-49e7-ad38-34b3d762ea7b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created volume successfully. Apr 10 16:24:27 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:27 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:27 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:27 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086050c-eef5-4d00-ba60-421cdd45cfbb]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:28 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 Apr 10 16:24:28 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.509s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:28 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:28 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 1G Apr 10 16:24:28 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 Apr 10 16:24:28 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028" returned: 0 in 0.515s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:28 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028 Apr 10 16:24:28 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862" returned: 0 in 0.472s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:28 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862 Apr 10 16:24:28 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 1G" returned: 0 in 0.561s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:28 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 Apr 10 16:24:28 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (1f837700-29e7-4851-8043-3751dbb4fbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15be8469-7c42-410e-949d-83f014c167f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15be8469-7c42-410e-949d-83f014c167f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-383230583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a14644-3c71-484b-9289-38dc1835a7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:29Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a949644-3b6d-43ae-9dfc-0814b889881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a949644-3b6d-43ae-9dfc-0814b889881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17edccf6-d7a5-4452-bd3c-13752a02500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17edccf6-d7a5-4452-bd3c-13752a02500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a14644-3c71-484b-9289-38dc1835a7d9', 'volume_name': 'volume-b3a14644-3c71-484b-9289-38dc1835a7d9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc242a-a9c0-4966-b782-01843b8e0c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc242a-a9c0-4966-b782-01843b8e0c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecc87b0-97c7-4238-89aa-08bec088f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:28 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume b3a14644-3c71-484b-9289-38dc1835a7d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a14644-3c71-484b-9289-38dc1835a7d9', 'volume_size': 1} Apr 10 16:24:28 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (f1fe3c08-f4ab-4421-8a7c-e2273ee07823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084dbb6f-9080-4219-b610-219ab090108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084dbb6f-9080-4219-b610-219ab090108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105910781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9362d891-29ee-496c-88f2-87cfd024aa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:29Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf10e9-65f4-4a8c-b6d6-a9766733cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf10e9-65f4-4a8c-b6d6-a9766733cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1b76d9-d386-45bb-a7de-852235fd43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1b76d9-d386-45bb-a7de-852235fd43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9362d891-29ee-496c-88f2-87cfd024aa9e', 'volume_name': 'volume-9362d891-29ee-496c-88f2-87cfd024aa9e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7e4b24-3ebe-4ca8-ab02-8ac72ec8259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7e4b24-3ebe-4ca8-ab02-8ac72ec8259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c010f-03ac-4029-a76f-c3e3de3cb745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume 9362d891-29ee-496c-88f2-87cfd024aa9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9362d891-29ee-496c-88f2-87cfd024aa9e', 'volume_size': 1} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:29 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028" returned: 0 in 0.624s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028" released by "delete_volume" :: held 1.163s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (f7034106-92a0-4183-b49f-6d0b365bac13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4333f776-8e37-4033-af8d-41f324f878d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['9a8d2ca7-27a8-413b-ae58-8e7c31da0a4c', '41e1b4d8-9292-491f-b350-f605db108481', '8ef964eb-096e-4bd7-b2ee-25036034cbf2', '4c4cb1f0-bb09-4b24-8d9a-701b2f7f8c15'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4333f776-8e37-4033-af8d-41f324f878d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419214269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962bb438-a1ce-445b-859c-1e99846dfa15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:29Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d3dc0f-25b4-4e55-9246-05d6824288e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d3dc0f-25b4-4e55-9246-05d6824288e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90eb1f5-7731-4c64-99d1-d8d4ab2d82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90eb1f5-7731-4c64-99d1-d8d4ab2d82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962bb438-a1ce-445b-859c-1e99846dfa15', 'volume_name': 'volume-962bb438-a1ce-445b-859c-1e99846dfa15', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2394c3-2132-4151-9b65-423a2eee764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2394c3-2132-4151-9b65-423a2eee764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0608229f-6c22-4f20-8c19-5700a74361ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume 962bb438-a1ce-445b-859c-1e99846dfa15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962bb438-a1ce-445b-859c-1e99846dfa15', 'volume_size': 1} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:29 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359.f447371f-01a4-4eb1-9a2c-e16ab2da0862" returned: 0 in 0.587s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-f447371f-01a4-4eb1-9a2c-e16ab2da0862" released by "_delete_snapshot" :: held 2.123s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-82e6a177-a081-4475-a7d6-9f0d7a485359" released by "delete_snapshot" :: held 2.149s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:29 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:29 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Created reservations ['b0d84403-8a5f-45d7-9654-385ff10b847d', '07c4dee5-ef00-45e5-af89-61871662f48e', '321afc69-573b-49b2-af61-24d34a55ac23', '8d5528ab-46ea-4f65-924f-5c457882b1c4'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Delete snapshot completed successfully. Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-30b8c0cd-9d1c-4a02-809e-41216e6fe8bf tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-f447371f-01a4-4eb1-9a2c-e16ab2da0862-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (d0dd6ecb-3bd5-4499-9090-0994a65e2a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919b2caa-b1ae-45d9-b959-c5fdaa151daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919b2caa-b1ae-45d9-b959-c5fdaa151daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852411196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5043a170-7c59-4f6b-ae82-3615163ede40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:30Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9b6d76-2541-486c-9897-34150dd093c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9b6d76-2541-486c-9897-34150dd093c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b97f862-f82a-461d-992d-ba78c9711879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b97f862-f82a-461d-992d-ba78c9711879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5043a170-7c59-4f6b-ae82-3615163ede40', 'volume_name': 'volume-5043a170-7c59-4f6b-ae82-3615163ede40', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2e475b-48bf-4c83-9777-826d3a4d2c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2e475b-48bf-4c83-9777-826d3a4d2c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3eb365-bdd8-4ce1-9b6f-0ada49bdac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume 5043a170-7c59-4f6b-ae82-3615163ede40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5043a170-7c59-4f6b-ae82-3615163ede40', 'volume_size': 1} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06" returned: 0 in 0.765s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:29 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 is being set with open permissions: ugo+rw Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:29 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 Apr 10 16:24:29 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (055ff620-64cb-4299-a9b4-959d4bbef231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1340a8aa-9bbb-44fa-a1ab-d3a147696c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1340a8aa-9bbb-44fa-a1ab-d3a147696c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1939633724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aea8083-d553-483e-bafb-d3216b55fab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:30Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8e11a3-350a-45c5-9ac9-82cc92833207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8e11a3-350a-45c5-9ac9-82cc92833207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658eb158-a11f-47b3-821c-c4c328dae4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658eb158-a11f-47b3-821c-c4c328dae4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aea8083-d553-483e-bafb-d3216b55fab5', 'volume_name': 'volume-5aea8083-d553-483e-bafb-d3216b55fab5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7057bb8-2888-447a-81f6-23f32d4537a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7057bb8-2888-447a-81f6-23f32d4537a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d503329-5853-486f-bd58-0591c3312eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:29 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume 5aea8083-d553-483e-bafb-d3216b55fab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aea8083-d553-483e-bafb-d3216b55fab5', 'volume_size': 1} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:29 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:29 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleted volume successfully. Apr 10 16:24:29 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-98344cb9-5549-47bf-9817-2a1ac7e01ec2 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-4bc396d8-aa0c-4c76-89fc-eb49ff4cf028-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:30 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06" returned: 0 in 0.437s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:30 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info Apr 10 16:24:30 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-6cf2a50f-80b6-47d4-babf-f7dc01283d9b-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-6cf2a50f-80b6-47d4-babf-f7dc01283d9b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-6cf2a50f-80b6-47d4-babf-f7dc01283d9b" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-6cf2a50f-80b6-47d4-babf-f7dc01283d9b" acquired by "delete_volume" :: waited 0.016s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3367ba68-5b50-41c5-8591-e0e01e1bf072]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:30 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b Apr 10 16:24:30 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-82e6a177-a081-4475-a7d6-9f0d7a485359-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-82e6a177-a081-4475-a7d6-9f0d7a485359-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-82e6a177-a081-4475-a7d6-9f0d7a485359" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-82e6a177-a081-4475-a7d6-9f0d7a485359" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666feb2-1ce8-4258-b346-2ee2b1ae8682]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:30 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:30 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:30 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info" returned: 0 in 0.465s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:30 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info is being set with open permissions: ugo+rw Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:30 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info Apr 10 16:24:30 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:30 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b" returned: 0 in 0.538s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:30 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b Apr 10 16:24:30 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:30 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.info" returned: 0 in 0.409s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:30 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.216s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:30 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.023s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-383230583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a14644-3c71-484b-9289-38dc1835a7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:29Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Creating volume b3a14644-3c71-484b-9289-38dc1835a7d9 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:31 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.529s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:31 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 1073741824 Apr 10 16:24:31 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:31 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-aae89eb4-94be-4b9f-b86f-9efe37b53ac3 tempest-SnapshotDependencyTests-1602553829 None] Create snapshot completed successfully Apr 10 16:24:31 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359 Apr 10 16:24:31 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:31 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-6cf2a50f-80b6-47d4-babf-f7dc01283d9b" returned: 0 in 0.465s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-6cf2a50f-80b6-47d4-babf-f7dc01283d9b" released by "delete_volume" :: held 1.022s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['e1ce67a0-deff-4877-9da7-3d766c06f6e6', 'a0986700-978e-4771-b811-074ca37b1f6f', '95a05131-e666-4eab-8318-e68fbeb2d649', '0f861a5f-3c8c-48e2-a37c-3ac1975f053e'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:31 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:31 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:31 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-82e6a177-a081-4475-a7d6-9f0d7a485359" returned: 0 in 0.499s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-82e6a177-a081-4475-a7d6-9f0d7a485359" released by "delete_volume" :: held 1.056s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:31 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 1073741824" returned: 0 in 0.533s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:31 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 Apr 10 16:24:31 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Created reservations ['080b9690-9cce-40d2-a129-418c105d49a2', '2d65098b-43cc-4f50-b00f-d321e55cd425', '7223a823-5139-42e4-a3df-e0792eac151a', 'ce9d0973-5e9b-437d-b811-0f83462d7216'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Flow 'volume_create_manager' (93ee2685-4dde-49c7-bbdc-7ad0d0d05844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64f4a20-8e1c-4e27-8937-7cba0d6dfde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64f4a20-8e1c-4e27-8937-7cba0d6dfde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de14b96a-a6cb-492b-bc70-da6db5b647fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16b81e73100408ebe983d15335ea239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c8deb00-47de-4424-9fc1-2fcb86d60b06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:32Z,use_quota=True,user_id='a700836e9b114d288305e5e33ef27819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbf37a9-d573-4be7-96a9-df74453f46c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbf37a9-d573-4be7-96a9-df74453f46c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac605e9-1256-4742-85e7-bdba5e989729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac605e9-1256-4742-85e7-bdba5e989729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de14b96a-a6cb-492b-bc70-da6db5b647fd', 'volume_name': 'volume-de14b96a-a6cb-492b-bc70-da6db5b647fd', 'volume_size': 1, 'snapshot_id': '9c8deb00-47de-4424-9fc1-2fcb86d60b06'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c278855a-652c-4dd8-aadf-0d5a6f0c2f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c278855a-652c-4dd8-aadf-0d5a6f0c2f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a854d1-f827-4004-83ff-db560af51586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:31 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Volume de14b96a-a6cb-492b-bc70-da6db5b647fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de14b96a-a6cb-492b-bc70-da6db5b647fd', 'volume_size': 1, 'snapshot_id': '9c8deb00-47de-4424-9fc1-2fcb86d60b06'} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:31 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:31 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:31 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.503s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:31 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleted volume successfully. Apr 10 16:24:31 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3a5f0da4-ed44-4900-ac62-cf17f93c20c8 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-6cf2a50f-80b6-47d4-babf-f7dc01283d9b-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:32 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105910781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9362d891-29ee-496c-88f2-87cfd024aa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:29Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Creating volume 9362d891-29ee-496c-88f2-87cfd024aa9e {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:32 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecc87b0-97c7-4238-89aa-08bec088f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a14644-3c71-484b-9289-38dc1835a7d9', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:32 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e 1073741824 Apr 10 16:24:32 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139c804b-367e-479b-a85c-ddd755d8d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:32 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume volume-b3a14644-3c71-484b-9289-38dc1835a7d9 (b3a14644-3c71-484b-9289-38dc1835a7d9): created successfully Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139c804b-367e-479b-a85c-ddd755d8d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (1f837700-29e7-4851-8043-3751dbb4fbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:32 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-bb2b0d93-89ec-4d97-b383-38ebb2a75ee6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created volume successfully. Apr 10 16:24:32 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.434s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:32 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Deleted volume successfully. Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5055e2ce-885e-4d8d-84bf-28c7b2a88c7a tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-82e6a177-a081-4475-a7d6-9f0d7a485359-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-992a49f3-d8cf-48a2-810f-5c39878e13e5-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-992a49f3-d8cf-48a2-810f-5c39878e13e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-618e5a43-d790-4d22-bd86-1b73ef283eb6" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-618e5a43-d790-4d22-bd86-1b73ef283eb6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-992a49f3-d8cf-48a2-810f-5c39878e13e5" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-992a49f3-d8cf-48a2-810f-5c39878e13e5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleting offline snapshot 992a49f3-d8cf-48a2-810f-5c39878e13e5 of volume 618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] snapshot_file for this snap is: volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be329b2-d203-4436-a0e4-90f4066b1d01]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:32 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e 1073741824" returned: 0 in 0.532s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:32 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 Apr 10 16:24:32 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:32 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e Apr 10 16:24:32 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (35a87a77-ace6-40e6-a1a3-5ca7da802824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508efce9-da2d-4591-86d0-08d853a3c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508efce9-da2d-4591-86d0-08d853a3c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-264933711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124c6a27-8daa-4235-a87d-237ac533372e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41697857a0f4d74a68bf9be597acb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:33Z,use_quota=True,user_id='59f9bd8e56094f5c95431ff2a6afa7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d71fb5-3b1a-4655-abcf-43be970b526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d71fb5-3b1a-4655-abcf-43be970b526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373b9bdc-3068-4b42-a06f-e2551da03db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373b9bdc-3068-4b42-a06f-e2551da03db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124c6a27-8daa-4235-a87d-237ac533372e', 'volume_name': 'volume-124c6a27-8daa-4235-a87d-237ac533372e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b1f3c4-bd24-457d-bd89-331099b73b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b1f3c4-bd24-457d-bd89-331099b73b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1824c4-8835-4487-b0ee-5fd2f12783ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:32 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Volume 124c6a27-8daa-4235-a87d-237ac533372e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124c6a27-8daa-4235-a87d-237ac533372e', 'volume_size': 1} Apr 10 16:24:32 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:33 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5" returned: 0 in 0.510s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-618e5a43-d790-4d22-bd86-1b73ef283eb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5b8a96-309b-48ff-a1f4-b10d7e147569]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:33 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e" returned: 0 in 0.487s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.701s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419214269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962bb438-a1ce-445b-859c-1e99846dfa15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:29Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Creating volume 962bb438-a1ce-445b-859c-1e99846dfa15 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:33 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c010f-03ac-4029-a76f-c3e3de3cb745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9362d891-29ee-496c-88f2-87cfd024aa9e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:33 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 1073741824 Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d822c13-c8ec-4982-8d7d-7d5a50a28705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:33 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:33 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 Apr 10 16:24:33 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:33 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume volume-9362d891-29ee-496c-88f2-87cfd024aa9e (9362d891-29ee-496c-88f2-87cfd024aa9e): created successfully Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d822c13-c8ec-4982-8d7d-7d5a50a28705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (f1fe3c08-f4ab-4421-8a7c-e2273ee07823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:33 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9e43a3ae-ddce-4b46-a903-a520afebf9f0 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created volume successfully. Apr 10 16:24:33 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6" returned: 0 in 0.481s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:33 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 Apr 10 16:24:33 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:33 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 1073741824" returned: 0 in 0.481s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:33 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 Apr 10 16:24:33 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:33 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5" returned: 0 in 0.474s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:33 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:34 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5 Apr 10 16:24:34 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:34 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.378s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852411196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5043a170-7c59-4f6b-ae82-3615163ede40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:30Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Creating volume 5043a170-7c59-4f6b-ae82-3615163ede40 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:34 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0608229f-6c22-4f20-8c19-5700a74361ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962bb438-a1ce-445b-859c-1e99846dfa15', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:34 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 1073741824 Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9772f2c4-b3b3-49a9-9e42-f167e65004a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:34 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:34 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume volume-962bb438-a1ce-445b-859c-1e99846dfa15 (962bb438-a1ce-445b-859c-1e99846dfa15): created successfully Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9772f2c4-b3b3-49a9-9e42-f167e65004a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (f7034106-92a0-4183-b49f-6d0b365bac13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-08dfaded-910b-4a34-a7cc-523de43f24f6 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created volume successfully. Apr 10 16:24:34 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6.992a49f3-d8cf-48a2-810f-5c39878e13e5" returned: 0 in 0.431s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-992a49f3-d8cf-48a2-810f-5c39878e13e5" released by "_delete_snapshot" :: held 1.943s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-618e5a43-d790-4d22-bd86-1b73ef283eb6" released by "delete_snapshot" :: held 1.966s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['80b09076-4d9e-42e7-8f7e-a1ee7323ef0a', '9156ffd9-8b42-4629-b775-de82c4b04993', 'c0495d35-217e-480e-8b45-915c4d6fbe7d', 'b0252d3c-d682-4f65-a9ac-0ab271970653'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:34 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Delete snapshot completed successfully. Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-91ca773f-d140-4854-8391-a8f28a4db02a tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-992a49f3-d8cf-48a2-810f-5c39878e13e5-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:34 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 1073741824" returned: 0 in 0.488s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:34 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 Apr 10 16:24:34 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-618e5a43-d790-4d22-bd86-1b73ef283eb6-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-618e5a43-d790-4d22-bd86-1b73ef283eb6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "cinder-quobyte-618e5a43-d790-4d22-bd86-1b73ef283eb6" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-618e5a43-d790-4d22-bd86-1b73ef283eb6" acquired by "delete_volume" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2fa4de-e347-4906-aaf7-eaa928b8fe0f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:34 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 Apr 10 16:24:34 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:34 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.134s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1939633724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aea8083-d553-483e-bafb-d3216b55fab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6b61cea55c4b4990b549b042918a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:30Z,use_quota=True,user_id='528ebb5dd4d3437b88e48ce25eb82dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Creating volume 5aea8083-d553-483e-bafb-d3216b55fab5 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:34 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:34 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3eb365-bdd8-4ce1-9b6f-0ada49bdac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5043a170-7c59-4f6b-ae82-3615163ede40', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:35 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 1073741824 Apr 10 16:24:35 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b2a0da-f1d3-449d-be14-fa4c38aad6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:35 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume volume-5043a170-7c59-4f6b-ae82-3615163ede40 (5043a170-7c59-4f6b-ae82-3615163ede40): created successfully Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b2a0da-f1d3-449d-be14-fa4c38aad6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (d0dd6ecb-3bd5-4499-9090-0994a65e2a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:35 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b298784c-f9cd-429b-a7cb-064938fc77e3 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created volume successfully. Apr 10 16:24:35 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6" returned: 0 in 0.485s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:35 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6 Apr 10 16:24:35 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:35 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 1073741824" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:35 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 Apr 10 16:24:35 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:35 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-618e5a43-d790-4d22-bd86-1b73ef283eb6" returned: 0 in 0.429s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-quobyte-618e5a43-d790-4d22-bd86-1b73ef283eb6" released by "delete_volume" :: held 0.949s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Created reservations ['9a960b10-4157-4ad2-b0f5-e336d7e89889', '646e4a54-cd59-48b5-8c97-e5aac0a75b5e', '0bbd622d-8fbd-4a32-ba62-f37f97828217', '0ec66bb8-d622-4aec-9bf2-e4ef6a1aa560'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:35 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:35 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:35 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5" returned: 0 in 0.451s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.236s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-quobyte-9c8deb00-47de-4424-9fc1-2fcb86d60b06-de14b96a-a6cb-492b-bc70-da6db5b647fd" by "_create_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d503329-5853-486f-bd58-0591c3312eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aea8083-d553-483e-bafb-d3216b55fab5', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d71920-a999-4a02-bc62-ba562f713e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-9c8deb00-47de-4424-9fc1-2fcb86d60b06-de14b96a-a6cb-492b-bc70-da6db5b647fd" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Creating volume de14b96a-a6cb-492b-bc70-da6db5b647fd from snapshot 9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-quobyte-de14b96a-a6cb-492b-bc70-da6db5b647fd" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:35 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Volume volume-5aea8083-d553-483e-bafb-d3216b55fab5 (5aea8083-d553-483e-bafb-d3216b55fab5): created successfully Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d71920-a999-4a02-bc62-ba562f713e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:35 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Flow 'volume_create_manager' (055ff620-64cb-4299-a9b4-959d4bbef231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-de14b96a-a6cb-492b-bc70-da6db5b647fd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] snapshot: 9c8deb00-47de-4424-9fc1-2fcb86d60b06, volume: de14b96a-a6cb-492b-bc70-da6db5b647fd, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:24:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8133b77f-1b97-4172-a256-915f0f1c5b0c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created volume successfully. Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15ff449-9e54-4cdf-a6f7-9061aed22f3e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:36 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 Apr 10 16:24:36 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:36 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.450s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:36 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Deleted volume successfully. Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-d109ae08-9f2b-45b7-be73-f4bd4616f517 tempest-CreateVolumesFromSnapshotTest-1727173781 None] Lock "cinder-618e5a43-d790-4d22-bd86-1b73ef283eb6-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-5aea8083-d553-483e-bafb-d3216b55fab5-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-5aea8083-d553-483e-bafb-d3216b55fab5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-quobyte-5aea8083-d553-483e-bafb-d3216b55fab5" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-5aea8083-d553-483e-bafb-d3216b55fab5" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92c2cf-2b55-4a31-a713-e5e27a5bb7d1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:36 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 Apr 10 16:24:36 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:36 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06" returned: 0 in 0.545s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c940945-9571-4203-b2c3-552e634a10c3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:36 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:36 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:36 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5" returned: 0 in 0.567s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:36 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:36 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5 Apr 10 16:24:36 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:37 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.546s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:37 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd Apr 10 16:24:37 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:37 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5aea8083-d553-483e-bafb-d3216b55fab5" returned: 0 in 0.486s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-5aea8083-d553-483e-bafb-d3216b55fab5" released by "delete_volume" :: held 1.085s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created reservations ['49faf99f-230f-4c8f-85ef-6da9d424e86d', 'e6de232e-61a9-4728-974a-1db67d86a6af', '3ebf6609-b917-41c4-9c9a-386da8291bb0', '2f0e94d4-cbaa-4cec-986d-e5fec387e1d8'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Flow 'volume_create_manager' (b3547bff-0833-4bdc-9616-5ca127abc0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a6dd82-7296-42f6-b6db-7f12fbaa75a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a6dd82-7296-42f6-b6db-7f12fbaa75a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304c1704-b49f-4520-bab6-766d4f4cf278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddfdfb9ac8f342809228c83373fa8ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:38Z,use_quota=True,user_id='66046b8cc2a04b30a7782dffca3d6f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc7340f-5e86-482b-8996-9b6103eecbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc7340f-5e86-482b-8996-9b6103eecbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211140a2-bc7e-408a-ae4d-a148fc82f8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211140a2-bc7e-408a-ae4d-a148fc82f8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304c1704-b49f-4520-bab6-766d4f4cf278', 'volume_name': 'volume-304c1704-b49f-4520-bab6-766d4f4cf278', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd1c447-f5f8-4ae5-b838-c014352d98a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd1c447-f5f8-4ae5-b838-c014352d98a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a26c5bf-4c3a-4306-ad80-46d1df8a1149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:37 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Volume 304c1704-b49f-4520-bab6-766d4f4cf278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304c1704-b49f-4520-bab6-766d4f4cf278', 'volume_size': 1} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:37 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:37 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:37 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:38 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-5043a170-7c59-4f6b-ae82-3615163ede40-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.931s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-5043a170-7c59-4f6b-ae82-3615163ede40-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:38 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Deleted volume successfully. Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-3353a25c-cd70-4805-9a86-a27ebe1f391b tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-5aea8083-d553-483e-bafb-d3216b55fab5-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-quobyte-5043a170-7c59-4f6b-ae82-3615163ede40" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-5043a170-7c59-4f6b-ae82-3615163ede40" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f14fa3-11a2-4070-aad9-52184566d0cb]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:38 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:39 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 Apr 10 16:24:39 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:39 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd" returned: 0 in 2.173s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a263ea-061f-40b1-bc6c-f6e3401082c9]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:39 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:39 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:39 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40" returned: 0 in 0.793s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:39 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40 Apr 10 16:24:39 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:39 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.577s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:24:39 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Converted 1024.00 MB image at 471.01 MB/s Apr 10 16:24:39 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd is being set with open permissions: ugo+rw Apr 10 16:24:39 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:39 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd Apr 10 16:24:39 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:40 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-5043a170-7c59-4f6b-ae82-3615163ede40" returned: 0 in 0.441s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-5043a170-7c59-4f6b-ae82-3615163ede40" released by "delete_volume" :: held 1.268s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created reservations ['f3861d91-f1ae-4fd9-ae06-285ed6ec32ec', '5251f97d-2d41-4628-bfc2-38df8f830642', '2b0d29f2-428c-4551-9a0e-d70156a86ead', '2da58dbf-64ba-43cb-9e80-94a3cfd3b1b3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:40 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:40 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:40 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd" returned: 0 in 0.428s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-de14b96a-a6cb-492b-bc70-da6db5b647fd" released by "_copy_volume_from_snapshot" :: held 4.342s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-9c8deb00-47de-4424-9fc1-2fcb86d60b06-de14b96a-a6cb-492b-bc70-da6db5b647fd" released by "_create_volume_from_snapshot" :: held 4.373s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.398s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.401s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-264933711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124c6a27-8daa-4235-a87d-237ac533372e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41697857a0f4d74a68bf9be597acb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:33Z,use_quota=True,user_id='59f9bd8e56094f5c95431ff2a6afa7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Creating volume 124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:40 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:40 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e 1073741824 Apr 10 16:24:40 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a854d1-f827-4004-83ff-db560af51586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de14b96a-a6cb-492b-bc70-da6db5b647fd', 'volume_size': 1, 'snapshot_id': '9c8deb00-47de-4424-9fc1-2fcb86d60b06'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8709cf-0347-405f-a420-2197dc62f7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:40 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Volume volume-de14b96a-a6cb-492b-bc70-da6db5b647fd (de14b96a-a6cb-492b-bc70-da6db5b647fd): created successfully Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8709cf-0347-405f-a420-2197dc62f7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Flow 'volume_create_manager' (93ee2685-4dde-49c7-bbdc-7ad0d0d05844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-b898c8c1-2ffc-4c8a-815b-26e5ccd85f30 tempest-SnapshotDependencyTests-1602553829 None] Created volume successfully. Apr 10 16:24:40 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.430s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:40 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Deleted volume successfully. Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-01a3c9f7-8b49-412a-98f6-fbb9a2ae1abe tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-5043a170-7c59-4f6b-ae82-3615163ede40-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-962bb438-a1ce-445b-859c-1e99846dfa15-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-962bb438-a1ce-445b-859c-1e99846dfa15-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-quobyte-962bb438-a1ce-445b-859c-1e99846dfa15" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:40 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e 1073741824" returned: 0 in 0.469s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-962bb438-a1ce-445b-859c-1e99846dfa15" acquired by "delete_volume" :: waited 0.024s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[62adaeee-fab5-476a-8c40-9c8ce3e459f1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:40 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:40 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:40 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:40 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 Apr 10 16:24:40 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-9c8deb00-47de-4424-9fc1-2fcb86d60b06-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-9c8deb00-47de-4424-9fc1-2fcb86d60b06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-quobyte-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:41 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-quobyte-9c8deb00-47de-4424-9fc1-2fcb86d60b06" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304c1704-b49f-4520-bab6-766d4f4cf278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddfdfb9ac8f342809228c83373fa8ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:38Z,use_quota=True,user_id='66046b8cc2a04b30a7782dffca3d6f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Creating volume 304c1704-b49f-4520-bab6-766d4f4cf278 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:41 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-9c8deb00-47de-4424-9fc1-2fcb86d60b06" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Deleting offline snapshot 9c8deb00-47de-4424-9fc1-2fcb86d60b06 of volume a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:24:41 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 1073741824 Apr 10 16:24:41 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] snapshot_file for this snap is: volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1824c4-8835-4487-b0ee-5fd2f12783ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124c6a27-8daa-4235-a87d-237ac533372e', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578ed5b5-6879-48fb-add0-d0e08b20b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[060002a8-aed8-41d8-a5a5-547888a8d104]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:41 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15" returned: 0 in 0.511s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:41 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Volume volume-124c6a27-8daa-4235-a87d-237ac533372e (124c6a27-8daa-4235-a87d-237ac533372e): created successfully Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578ed5b5-6879-48fb-add0-d0e08b20b95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (35a87a77-ace6-40e6-a1a3-5ca7da802824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:41 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15 Apr 10 16:24:41 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:41 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-78e6e223-b725-4640-aa23-2e189e8f579e tempest-VolumeDependencyTests-1972611021 None] Created volume successfully. Apr 10 16:24:41 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 Apr 10 16:24:41 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:41 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 1073741824" returned: 0 in 0.463s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:41 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-962bb438-a1ce-445b-859c-1e99846dfa15" returned: 0 in 0.447s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-962bb438-a1ce-445b-859c-1e99846dfa15" released by "delete_volume" :: held 0.990s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:41 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 Apr 10 16:24:41 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created reservations ['7234f8ef-dd29-40e3-b1e6-da8732bb3c41', '54cf684f-538c-4bf7-ae52-1d9f6c184d5e', 'a83955ce-60ee-4bcd-b5ec-807bd9f4946c', 'b81aa4cd-38ca-4ee7-996d-9d81316fba6f'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:41 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06" returned: 0 in 0.526s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0830856b-8b09-4adf-8081-5af589ac7c88]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:41 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:41 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:41 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:41 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:41 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:42 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278" returned: 0 in 0.440s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a26c5bf-4c3a-4306-ad80-46d1df8a1149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304c1704-b49f-4520-bab6-766d4f4cf278', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d600b6ea-e24a-4e00-8ac1-8303106c9a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:42 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Volume volume-304c1704-b49f-4520-bab6-766d4f4cf278 (304c1704-b49f-4520-bab6-766d4f4cf278): created successfully Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d600b6ea-e24a-4e00-8ac1-8303106c9a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Flow 'volume_create_manager' (b3547bff-0833-4bdc-9616-5ca127abc0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:42 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0c6d6422-f6e4-4550-a278-5e3194515157 tempest-CinderUnicodeTest-1974265516 None] Created volume successfully. Apr 10 16:24:42 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.401s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:42 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Deleted volume successfully. Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-e2ae71cb-6c49-4546-bd38-4374ea5d117c tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-962bb438-a1ce-445b-859c-1e99846dfa15-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:42 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.483s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:42 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 Apr 10 16:24:42 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (423a6a55-85f3-474e-943b-243d23f89038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72289a76-cd0e-46d1-b670-6b83236eec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72289a76-cd0e-46d1-b670-6b83236eec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1643312985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bca727-bcf7-4691-9715-a1e367910084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41697857a0f4d74a68bf9be597acb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=124c6a27-8daa-4235-a87d-237ac533372e,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:43Z,use_quota=True,user_id='59f9bd8e56094f5c95431ff2a6afa7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deceaeca-5c02-43ab-875f-68df60f126d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deceaeca-5c02-43ab-875f-68df60f126d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcba0f6-d8d0-4722-adfd-1207081692b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcba0f6-d8d0-4722-adfd-1207081692b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '71bca727-bcf7-4691-9715-a1e367910084', 'volume_name': 'volume-71bca727-bcf7-4691-9715-a1e367910084', 'volume_size': 1, 'source_volid': '124c6a27-8daa-4235-a87d-237ac533372e', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c706a8-d4e6-4e6c-8448-253a321705cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c706a8-d4e6-4e6c-8448-253a321705cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a6f4fb-0825-4355-9a71-ee3dcf4196e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:42 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Volume 71bca727-bcf7-4691-9715-a1e367910084: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-71bca727-bcf7-4691-9715-a1e367910084', 'volume_size': 1, 'source_volid': '124c6a27-8daa-4235-a87d-237ac533372e', 'source_volstatus': 'available'} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:42 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Cloning volume 124c6a27-8daa-4235-a87d-237ac533372e to volume 71bca727-bcf7-4691-9715-a1e367910084 Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Creating offline snapshot a2bf59be-5c4f-4a00-afad-40d2c2cd7592 of volume 124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1679b6-b41c-4fa1-929b-16cafe2d026e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:42 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06" returned: 0 in 0.472s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:42 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06 Apr 10 16:24:42 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:42 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:42 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-9362d891-29ee-496c-88f2-87cfd024aa9e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:42 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-9362d891-29ee-496c-88f2-87cfd024aa9e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-quobyte-9362d891-29ee-496c-88f2-87cfd024aa9e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-9362d891-29ee-496c-88f2-87cfd024aa9e" acquired by "delete_volume" :: waited 0.014s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c773ddf0-2a97-476e-aead-24f9b4ecb544]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:43 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e Apr 10 16:24:43 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82117) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Flow 'volume_create_manager' (d068ced7-5215-47f2-9a21-a8345050172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f21adb8-053f-45ca-b586-ec2dd50bc451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f21adb8-053f-45ca-b586-ec2dd50bc451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2059394495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddfdfb9ac8f342809228c83373fa8ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:43Z,use_quota=True,user_id='66046b8cc2a04b30a7782dffca3d6f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b505336e-78c2-483e-b1e6-300362f71a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b505336e-78c2-483e-b1e6-300362f71a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a543880f-1b18-41f4-8149-a64b0d1b2505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a543880f-1b18-41f4-8149-a64b0d1b2505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3', 'volume_name': 'volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea87155-f9ef-4867-bf7e-74d62a272e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea87155-f9ef-4867-bf7e-74d62a272e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376baa08-a1c1-4589-9e7a-9e040d74a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:43 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Volume 636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3', 'volume_size': 1} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:43 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:43 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3.9c8deb00-47de-4424-9fc1-2fcb86d60b06" returned: 0 in 0.510s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.568s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-9c8deb00-47de-4424-9fc1-2fcb86d60b06" released by "_delete_snapshot" :: held 2.081s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" released by "delete_snapshot" :: held 2.120s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:43 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 1G Apr 10 16:24:43 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Created reservations ['18ada5f9-ab37-4644-87a0-ea755b9e07c4', 'ec244bca-bbed-4e9e-8b6c-8c4213203dd7', 'f6520df0-4ae0-4dd7-ab25-a9111be99609', '0089e1bf-cb93-42cf-993d-df6ce11c3af8'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:43 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Delete snapshot completed successfully. Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-18a0b65a-bd72-4fc6-af76-48bdc5299a32 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-9c8deb00-47de-4424-9fc1-2fcb86d60b06-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:43 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e" returned: 0 in 0.535s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:43 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e Apr 10 16:24:43 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:43 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 1G" returned: 0 in 0.473s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124c6a27-8daa-4235-a87d-237ac533372e -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:43 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124c6a27-8daa-4235-a87d-237ac533372e -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 Apr 10 16:24:43 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:43 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:43 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-9362d891-29ee-496c-88f2-87cfd024aa9e" returned: 0 in 0.425s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-9362d891-29ee-496c-88f2-87cfd024aa9e" released by "delete_volume" :: held 0.983s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created reservations ['e12db8a8-e4b6-4e66-bc75-a0a74c019d16', '01ee09f1-9eb3-4cea-9dc4-54dbe8f0e260', '5182f48b-079a-42a6-8aa7-4015e69595ab', '20ac4b0f-55aa-4973-8543-c94b27bbc18e'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:44 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-b3a14644-3c71-484b-9289-38dc1835a7d9-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-b3a14644-3c71-484b-9289-38dc1835a7d9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-quobyte-b3a14644-3c71-484b-9289-38dc1835a7d9" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-b3a14644-3c71-484b-9289-38dc1835a7d9" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef400d-699a-4736-8778-ffc911ffc3e1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 Apr 10 16:24:44 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:44 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124c6a27-8daa-4235-a87d-237ac533372e -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592" returned: 0 in 0.431s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:44 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 is being set with open permissions: ugo+rw Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 Apr 10 16:24:44 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-quobyte-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" acquired by "delete_volume" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26341cb-8e41-470d-ace9-c79a0114d8c3]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:44 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:44 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.462s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:44 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Deleted volume successfully. Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-78a3a9a5-8162-4ca5-828e-229fe1a30bf9 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-9362d891-29ee-496c-88f2-87cfd024aa9e-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:44 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592" returned: 0 in 0.427s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:44 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9" returned: 0 in 0.540s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9 Apr 10 16:24:44 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:44 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info Apr 10 16:24:44 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:44 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.509s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:44 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:44 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3 Apr 10 16:24:44 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:45 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-b3a14644-3c71-484b-9289-38dc1835a7d9" returned: 0 in 0.393s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-b3a14644-3c71-484b-9289-38dc1835a7d9" released by "delete_volume" :: held 0.952s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:45 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info" returned: 0 in 0.395s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:45 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info is being set with open permissions: ugo+rw Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:45 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info Apr 10 16:24:45 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created reservations ['9005f52a-4070-4f05-a3a0-b1819f706b49', '71107699-05b3-4e2a-951b-d7b017c578d1', '32d85519-720a-4a3a-a8fc-4af3f3bedd9e', '0ef87f33-9176-42b5-8887-4d0f6a5a185a'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:45 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:45 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:45 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" returned: 0 in 0.424s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3" released by "delete_volume" :: held 0.959s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Created reservations ['987e87e1-1a28-402f-9a2a-a3f6dac0e183', '6247fd0d-2c75-4baa-b328-3519428db56f', '034cb910-c49d-44ce-9548-84f2c0744c5a', '283c2639-1133-4592-996c-d160e29bdac6'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:45 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:45 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-de14b96a-a6cb-492b-bc70-da6db5b647fd-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-de14b96a-a6cb-492b-bc70-da6db5b647fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "cinder-quobyte-de14b96a-a6cb-492b-bc70-da6db5b647fd" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-de14b96a-a6cb-492b-bc70-da6db5b647fd" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd7fa3-79d3-4dbf-a788-1d1b90da7d35]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:45 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd Apr 10 16:24:45 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:45 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.info" returned: 0 in 0.543s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-71bca727-bcf7-4691-9715-a1e367910084" by "_copy_volume_from_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-71bca727-bcf7-4691-9715-a1e367910084" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] snapshot: a2bf59be-5c4f-4a00-afad-40d2c2cd7592, volume: 71bca727-bcf7-4691-9715-a1e367910084, {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 16:24:45 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.473s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f5fd3-80ea-4356-b733-9481e6145752]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Deleted volume successfully. Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-490d7b9a-0e2d-4bbb-9a4b-5393b72101a5 tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-b3a14644-3c71-484b-9289-38dc1835a7d9-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:45 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 Apr 10 16:24:45 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:45 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.449s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:45 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Deleted volume successfully. Apr 10 16:24:45 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-a05e060f-93d4-40a6-835f-220f976918ed tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-a37cdee5-f63f-4ce5-a87a-3bebdd140eb3-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:46 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd" returned: 0 in 0.501s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:46 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd Apr 10 16:24:46 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:46 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592" returned: 0 in 0.467s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124c6a27-8daa-4235-a87d-237ac533372e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Creating direct copy from snapshot {{(pid=82117) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8d0f7-6d60-4fa8-96b5-4d7ca590a1e1]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:46 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:46 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-be2aa6d5-445e-4f63-a75d-c1463d9ca733-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-be2aa6d5-445e-4f63-a75d-c1463d9ca733-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "cinder-quobyte-be2aa6d5-445e-4f63-a75d-c1463d9ca733" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-be2aa6d5-445e-4f63-a75d-c1463d9ca733" acquired by "delete_volume" :: waited 0.017s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[905ed104-f337-47d6-ad86-abae9c7f0aaf]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:46 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 Apr 10 16:24:46 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:46 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-de14b96a-a6cb-492b-bc70-da6db5b647fd" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-quobyte-de14b96a-a6cb-492b-bc70-da6db5b647fd" released by "delete_volume" :: held 0.973s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Created reservations ['06282296-871b-4b3c-be45-655f60725d63', 'c3471396-1e79-400b-82d1-d6144aac63a5', '60c6c0c7-7f65-4911-b489-53b01558efea', 'e847f8c6-7e78-4ac8-b357-b7a8c459a914'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:46 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:46 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:46 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.541s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG cinder.utils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Path /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 not found in is_blk_device check {{(pid=82117) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:46 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 Apr 10 16:24:46 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:46 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733" returned: 0 in 0.483s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:46 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:46 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733 Apr 10 16:24:46 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:47 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.450s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:47 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Deleted volume successfully. Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-558ba67e-5933-497a-a28a-1726ddddbb19 tempest-SnapshotDependencyTests-1602553829 None] Lock "cinder-de14b96a-a6cb-492b-bc70-da6db5b647fd-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:47 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-be2aa6d5-445e-4f63-a75d-c1463d9ca733" returned: 0 in 0.821s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-quobyte-be2aa6d5-445e-4f63-a75d-c1463d9ca733" released by "delete_volume" :: held 1.326s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Created reservations ['203172ff-aeee-4f27-a890-547716eca64f', 'd1804490-497e-4b0b-9556-a569dd63c115', '5670c417-4108-422f-96a8-59f062009840', '9961de2b-9948-42c6-a648-d26f700c68b0'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:47 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:47 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:47 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:48 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084" returned: 0 in 2.204s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:48 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38fef81-470b-4655-be6b-b6c668a24b84]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:48 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:49 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 1.168s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:49 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:49 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Deleted volume successfully. Apr 10 16:24:49 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-bac437ee-a27a-4f0e-8cd8-48b04391407f tempest-CreateVolumesFromSourceVolumeTest-1761580861 None] Lock "cinder-be2aa6d5-445e-4f63-a75d-c1463d9ca733-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:49 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:49 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:49 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.758s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:49 devstack cinder-volume[82117]: DEBUG cinder.image.image_utils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Image conversion details: src /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 {{(pid=82117) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 16:24:49 devstack cinder-volume[82117]: INFO cinder.image.image_utils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Converted 1024.00 MB image at 464.29 MB/s Apr 10 16:24:49 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 is being set with open permissions: ugo+rw Apr 10 16:24:49 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:49 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 Apr 10 16:24:49 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:50 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084" returned: 0 in 0.416s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-71bca727-bcf7-4691-9715-a1e367910084" released by "_copy_volume_from_snapshot" :: held 4.431s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-a2bf59be-5c4f-4a00-afad-40d2c2cd7592" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-a2bf59be-5c4f-4a00-afad-40d2c2cd7592" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Deleting offline snapshot a2bf59be-5c4f-4a00-afad-40d2c2cd7592 of volume 124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] snapshot_file for this snap is: volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[02874e81-b516-497a-9a7c-33d78d9265af]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:50 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 Apr 10 16:24:50 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:50 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592" returned: 0 in 0.534s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124c6a27-8daa-4235-a87d-237ac533372e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08be62-12c5-43cc-8cba-9a89999c5609]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:50 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:50 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:50 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:51 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.551s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:51 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 Apr 10 16:24:51 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:51 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592" returned: 0 in 0.503s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:51 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:51 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592 Apr 10 16:24:51 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:52 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e.a2bf59be-5c4f-4a00-afad-40d2c2cd7592" returned: 0 in 0.428s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-a2bf59be-5c4f-4a00-afad-40d2c2cd7592" released by "_delete_snapshot" :: held 2.071s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.457s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.971s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T14:24:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2059394495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddfdfb9ac8f342809228c83373fa8ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T14:24:43Z,use_quota=True,user_id='66046b8cc2a04b30a7782dffca3d6f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124ab583-3c7c-493b-b2ef-994a817d13b6),volume_type_id=124ab583-3c7c-493b-b2ef-994a817d13b6)}" {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Creating volume 636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Selected osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 as target Quobyte volume. {{(pid=82117) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 16:24:52 devstack cinder-volume[82117]: INFO cinder.volume.drivers.remotefs [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] casted to osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79 Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 1073741824 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:52 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 1073741824 Apr 10 16:24:52 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a6f4fb-0825-4355-9a71-ee3dcf4196e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bca727-bcf7-4691-9715-a1e367910084', 'volume_size': 1, 'source_volid': '124c6a27-8daa-4235-a87d-237ac533372e', 'source_volstatus': 'available'}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b73796-f5fe-4dd2-a7f9-8fcc68a35c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:52 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Volume volume-71bca727-bcf7-4691-9715-a1e367910084 (71bca727-bcf7-4691-9715-a1e367910084): created successfully Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b73796-f5fe-4dd2-a7f9-8fcc68a35c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Flow 'volume_create_manager' (423a6a55-85f3-474e-943b-243d23f89038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:52 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-7a7fb88a-d23d-4b74-ac64-6cff2676646d tempest-VolumeDependencyTests-1972611021 None] Created volume successfully. Apr 10 16:24:52 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 1073741824" returned: 0 in 0.518s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:52 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:52 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 Apr 10 16:24:52 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:53 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" returned: 0 in 0.434s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'} {{(pid=82117) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376baa08-a1c1-4589-9e7a-9e040d74a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3', 'volume_size': 1}' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066deea1-ad49-4b5e-aade-ae3771bed1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 16:24:53 devstack cinder-volume[82117]: INFO cinder.volume.flows.manager.create_volume [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Volume volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 (636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3): created successfully Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066deea1-ad49-4b5e-aade-ae3771bed1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82117) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Flow 'volume_create_manager' (d068ced7-5215-47f2-9a21-a8345050172c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82117) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 16:24:53 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-9d1c670c-b2c8-419e-b88c-86555a6903b4 tempest-CinderUnicodeTest-1974265516 None] Created volume successfully. Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-124c6a27-8daa-4235-a87d-237ac533372e-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-124c6a27-8daa-4235-a87d-237ac533372e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-124c6a27-8daa-4235-a87d-237ac533372e" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-124c6a27-8daa-4235-a87d-237ac533372e" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[200cc008-09f0-4368-8541-24949c3b8b0c]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:53 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:53 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:53 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.552s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:53 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:53 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e Apr 10 16:24:53 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Creating offline snapshot f1c8c218-bb66-4fee-b335-19ad6a041a92 of volume 636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb1867-9960-4b9b-9226-90d0a66b782f]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:54 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 Apr 10 16:24:54 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:54 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-124c6a27-8daa-4235-a87d-237ac533372e" returned: 0 in 0.517s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-124c6a27-8daa-4235-a87d-237ac533372e" released by "delete_volume" :: held 1.098s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=168,cinder:UPDATE=261,cinder:DELETE=29,cinder:INSERT=61 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Created reservations ['aff211eb-1ee2-4b65-9644-5c9ade1c7e94', '24783419-82b2-4332-bab0-af2f833a6974', '19570114-60c2-4ab9-bc2e-6f56a33820d8', '17255061-91e3-4658-9b78-217cccc107af'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:54 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:54 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:54 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" returned: 0 in 0.588s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 1G {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:54 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 1G Apr 10 16:24:54 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:54 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.416s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:54 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Deleted volume successfully. Apr 10 16:24:54 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c845179d-0009-4805-a80a-984903277c45 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-124c6a27-8daa-4235-a87d-237ac533372e-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:55 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 1G" returned: 0 in 0.480s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:55 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 Apr 10 16:24:55 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-71bca727-bcf7-4691-9715-a1e367910084-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-71bca727-bcf7-4691-9715-a1e367910084-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-71bca727-bcf7-4691-9715-a1e367910084" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-71bca727-bcf7-4691-9715-a1e367910084" acquired by "delete_volume" :: waited 0.011s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2e5c6-6fd2-4172-85be-b4eeef08775e]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:55 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 -F qcow2 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92" returned: 0 in 0.442s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:55 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 is being set with open permissions: ugo+rw Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:55 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 Apr 10 16:24:55 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:55 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 Apr 10 16:24:55 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:55 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:55 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:55 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92" returned: 0 in 0.402s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:56 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084 Apr 10 16:24:56 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:56 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info Apr 10 16:24:56 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:56 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-71bca727-bcf7-4691-9715-a1e367910084" returned: 0 in 0.426s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-71bca727-bcf7-4691-9715-a1e367910084" released by "delete_volume" :: held 0.897s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:56 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info" returned: 0 in 0.406s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:56 devstack cinder-volume[82117]: WARNING cinder.volume.drivers.remotefs [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info is being set with open permissions: ugo+rw Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Created reservations ['3407e114-da79-4dd5-91a7-2501b0010b85', 'c9edd338-622f-4571-8cd3-5ef49fc7683e', '6470b270-593b-4892-ae96-2d7445933c36', '7ef5a38d-d90e-45c4-8baa-1828ca6b52da'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:56 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info Apr 10 16:24:56 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:56 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:56 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-68875414-68ef-43fe-a438-d8a363326f5a-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-68875414-68ef-43fe-a438-d8a363326f5a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "cinder-quobyte-68875414-68ef-43fe-a438-d8a363326f5a" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-68875414-68ef-43fe-a438-d8a363326f5a" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d02d24-1634-445f-ac60-dd2c068f54cb]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:56 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a Apr 10 16:24:56 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:56 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.info" returned: 0 in 0.457s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f043e5da-ec16-4e98-b7dd-c0afcf27663a tempest-CinderUnicodeTest-1974265516 None] Create snapshot completed successfully Apr 10 16:24:56 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:56 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Deleted volume successfully. Apr 10 16:24:56 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-f0f8d73e-eaab-49e5-a137-61924a9a02b8 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-71bca727-bcf7-4691-9715-a1e367910084-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:57 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a" returned: 0 in 0.472s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:57 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a Apr 10 16:24:57 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-f1c8c218-bb66-4fee-b335-19ad6a041a92-delete_snapshot" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-f1c8c218-bb66-4fee-b335-19ad6a041a92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-quobyte-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" by "delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-quobyte-f1c8c218-bb66-4fee-b335-19ad6a041a92" by "_delete_snapshot" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-f1c8c218-bb66-4fee-b335-19ad6a041a92" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Deleting offline snapshot f1c8c218-bb66-4fee-b335-19ad6a041a92 of volume 636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] snapshot_file for this snap is: volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 {{(pid=82117) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[27661b85-503e-41c1-868b-8409215f1866]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:57 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 Apr 10 16:24:57 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:57 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-68875414-68ef-43fe-a438-d8a363326f5a" returned: 0 in 0.446s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-quobyte-68875414-68ef-43fe-a438-d8a363326f5a" released by "delete_volume" :: held 0.939s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Created reservations ['67682ed6-4f39-4449-8706-125f0b6e4db4', '53c8ad1e-5d8b-48c3-b7f3-8610b6eb1ccb', '9cee38bc-6219-4b05-a090-ccb530545b6d', '13137922-281e-4fa7-9f29-3c032ab8d6c3'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:57 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92" returned: 0 in 0.468s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.remotefs [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82117) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 16:24:57 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:24:57 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b807dd8-f404-4bfd-abbe-af16d222d3dc]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:57 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:57 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 Apr 10 16:24:57 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:58 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.452s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:24:58 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Deleted volume successfully. Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-8e7997f1-e1a2-4a69-b749-d7335acba1c1 tempest-VolumeDependencyTests-1972611021 None] Lock "cinder-68875414-68ef-43fe-a438-d8a363326f5a-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:58 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" returned: 0 in 0.525s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:58 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 Apr 10 16:24:58 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:58 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92" returned: 0 in 0.495s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:58 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:58 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92 Apr 10 16:24:58 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:59 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3.f1c8c218-bb66-4fee-b335-19ad6a041a92" returned: 0 in 0.406s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-f1c8c218-bb66-4fee-b335-19ad6a041a92" released by "_delete_snapshot" :: held 1.954s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" released by "delete_snapshot" :: held 1.970s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Created reservations ['d60078ca-287a-4042-85c6-e2e6fc22acc5', '788775e4-ff42-485e-851f-b60d3faf17dd', '5e5f4500-8f41-45e4-af38-9af017ba4bcd', 'b101380f-b627-4d11-b2b7-2b85eacd81fd'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:24:59 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Delete snapshot completed successfully. Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-c0ba7abb-ccc0-4af9-a55f-a4ff62c67a18 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-f1c8c218-bb66-4fee-b335-19ad6a041a92-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-quobyte-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" acquired by "delete_volume" :: waited 0.007s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5876851-c400-4a3b-9e36-83b434d983aa]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:59 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 Apr 10 16:24:59 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:24:59 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" returned: 0 in 0.450s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:24:59 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:24:59 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3 Apr 10 16:24:59 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:25:00 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" returned: 0 in 0.392s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3" released by "delete_volume" :: held 0.883s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Created reservations ['bf6b82ec-dd5e-4eac-964f-4d239e57d76f', '8f9ea19e-89cb-472e-b709-f3125ac035eb', '17c4519a-b44e-4da6-a8ae-54013ce29b67', 'e3b4126e-cf35-49e7-b4b2-83d60b1772d8'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:25:00 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:25:00 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-304c1704-b49f-4520-bab6-766d4f4cf278-delete_volume" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-304c1704-b49f-4520-bab6-766d4f4cf278-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "cinder-quobyte-304c1704-b49f-4520-bab6-766d4f4cf278" by "delete_volume" {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-304c1704-b49f-4520-bab6-766d4f4cf278" acquired by "delete_volume" :: waited 0.010s {{(pid=82117) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c526eae-f5e1-46cb-8d0c-640ab19f1b0a]: (4, 'qcow2') {{(pid=83033) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:25:00 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 Apr 10 16:25:00 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:25:00 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.444s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:25:00 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Deleted volume successfully. Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-5e18cf20-d3d6-4f7d-8c7f-15531414e693 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-636d9634-4f2b-42b3-8a6c-7d0d4c84b1b3-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:25:00 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278" returned: 0 in 0.454s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:25:00 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:25:00 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278 Apr 10 16:25:00 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:25:01 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b/volume-304c1704-b49f-4520-bab6-766d4f4cf278" returned: 0 in 0.388s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-quobyte-304c1704-b49f-4520-bab6-766d4f4cf278" released by "delete_volume" :: held 0.877s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG cinder.quota [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Created reservations ['dff14dee-dce0-440c-ae58-f5013fe69cc3', 'bff4965d-0dfa-42ad-af6b-9e90293b814b', 'c37e2638-17bc-4641-8fb9-2691471c478b', '593b379e-1aa8-4814-8a6b-964c87553772'] {{(pid=82117) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79': None} {{(pid=82117) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG cinder.volume.drivers.quobyte [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4bb65b64-20a4-4779-ab0a-b3470db7be79'] {{(pid=82117) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.lockutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82117) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 16:25:01 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b Apr 10 16:25:01 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 16:25:01 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG oslo_concurrency.processutils [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4af0d0322c9aba7b72da8137f245e22b" returned: 0 in 0.457s {{(pid=82117) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG cinder.manager [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Notifying Schedulers of capabilities ... {{(pid=82117) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 16:25:01 devstack cinder-volume[82117]: INFO cinder.volume.manager [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Deleted volume successfully. Apr 10 16:25:01 devstack cinder-volume[82117]: DEBUG cinder.coordination [None req-0fefb03c-e1da-4c98-8d24-a388a1a56906 tempest-CinderUnicodeTest-1974265516 None] Lock "cinder-304c1704-b49f-4520-bab6-766d4f4cf278-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82117) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 16:25:11 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:SELECT=231,cinder:UPDATE=289,cinder:INSERT=74,cinder:DELETE=22 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 16:25:11 devstack cinder-volume[82117]: DEBUG dbcounter [-] [82117] Writing DB stats cinder:UPDATE=59,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=10 {{(pid=82117) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}